| *** mrHat has joined #cc | 00:01 | |
| *** BobChao has quit IRC | 00:03 | |
| *** mrHat has left #cc | 00:03 | |
| *** veeliam has left #cc | 00:14 | |
| *** Sarterus has quit IRC | 00:16 | |
| *** Sarterus has joined #cc | 00:19 | |
| *** Sarterus has left #cc | 00:29 | |
| *** ereslibre has quit IRC | 00:30 | |
| *** EnRohbi has left #cc | 00:45 | |
| *** cB_ is now known as CharelB | 01:13 | |
| *** CharelB is now known as cB | 01:15 | |
| *** [mharrison] has joined #cc | 01:20 | |
| *** cB is now known as CharelB | 01:21 | |
| *** pmiller has quit IRC | 01:38 | |
| *** [mharrison] has quit IRC | 02:50 | |
| *** isforinsects has quit IRC | 03:48 | |
| *** isforinsects has joined #cc | 03:54 | |
| *** isforinsects has quit IRC | 04:01 | |
| *** Roderick__ has joined #CC | 04:21 | |
| *** isforinsects has joined #cc | 04:21 | |
| *** [mharrison] has joined #cc | 04:32 | |
| *** Roderick_ has quit IRC | 04:39 | |
| *** Roderick_ has joined #CC | 04:56 | |
| *** Roderick__ has quit IRC | 05:14 | |
| *** rohitj has joined #cc | 05:19 | |
| *** ankitg has joined #cc | 05:32 | |
| ankitg | paulproteus: Hi | 05:56 |
|---|---|---|
| paulproteus | Hi ankitg! | 05:57 |
| paulproteus | What's up? | 05:58 |
| *** [mharrison] has quit IRC | 05:59 | |
| ankitg | I went over the python part ... seems like the only way to not read the whole file to memory is to read it character by character ... even readlines() reads the whole file into memory ... anyways, fixed that ... presently encountering some problems with S3Sync ... when looking at the S3 repo from the EC2 AMI, S3Sync shows me A1 though A4 and apps but no A5 ++ ... the i.creativecommons.org stuff is on A5 ... is it because of some varnish magic | 05:59 |
| paulproteus | ankitg, That's false! | 06:00 |
| paulproteus | for line in open(file): | 06:00 |
| paulproteus | print line | 06:00 |
| paulproteus | That's a buffered reader, I promise. | 06:00 |
| paulproteus | That's not something I've experienced re: S3 from EC2. | 06:00 |
| paulproteus | Can you let me SSH in and see what you're seeing? | 06:01 |
| ankitg | open on a .gz file without using gzip.GzipFile? | 06:01 |
| paulproteus | Interesting, a GzipFile. | 06:01 |
| paulproteus | Still, you should be able to get away with: | 06:01 |
| paulproteus | for line in gzip.GzipFile(filename): | 06:01 |
| ankitg | all the logs are Gzipped | 06:01 |
| paulproteus | print line | 06:01 |
| ankitg | ah, okie, I was trying for line in gzip.GzipFile(filename).$read_something() ... that works ... why don't people mention that in examples more often ... anyways, thanks, will update the python part accordingly ... | 06:04 |
| paulproteus | Sure. This is why I say to ask me questions sooner rather than later! | 06:04 |
| paulproteus | (-: | 06:04 |
| ankitg | as for the S3 thing ... you want me to give the AMI a static IP and pass that to you or with this work since you have the environment setup :: ssh -i id_rsa-pstam-keypair root@ec2-75-101-255-228.compute-1.amazonaws.com | 06:05 |
| paulproteus | I think that I don't have your private key. But if you email it to me, I'll be able to log in. | 06:06 |
| * ankitg doesn't trust email any more but proceeds with it anyways ... | 06:06 | |
| *** rohitj has quit IRC | 06:08 | |
| ankitg | mail sent ... it's a fwd-ed mail so check filters accordingly ... | 06:10 |
| paulproteus | ankitg, i mean the *ssh* private key. | 06:11 |
| paulproteus | The id_* file you have created as part of setting up the machine. | 06:11 |
| ankitg | ah the one I generated for the EC2 ... right ... let me just send that ... | 06:12 |
| paulproteus | id_rsa-pstam-keypair and its matching id_rsa-pstam-keypair.pub. | 06:13 |
| * paulproteus nods | 06:13 | |
| paulproteus | I don't actually probably need the .pub. | 06:13 |
| ankitg | erm, did you get it yet? | 06:22 |
| paulproteus | Yes. | 06:23 |
| ankitg | phew ... | 06:24 |
| paulproteus | I'm in. | 06:24 |
| paulproteus | Now let me see about this S3sync issue. | 06:25 |
| ankitg | okie ... I did a ./s3cmd.rb list ccommons:var/log/apache/a5 ... returns nothing ... then I did ./s3cmd.rb list ccommons:var/log/apache and went all the way, only till a4 no a5 ... | 06:25 |
| paulproteus | How do I set up the environment variables the way s3sync wants them? | 06:27 |
| ankitg | export AWS_ACCESS_KEY_ID= & export AWS_SECRET_ACCESS_KEY= Or a yml file | 06:27 |
| ankitg | email the keys to you / Gtalk? | 06:28 |
| paulproteus | Do you have those conveniently stored somewhere on the AMI? | 06:28 |
| paulproteus | Just put them on the AMI. | 06:28 |
| ankitg | ah, okie | 06:28 |
| ankitg | done | 06:29 |
| paulproteus | ...where are they on the AMI? | 06:31 |
| ankitg | something is wrong, I just put them there ... and I don't see anything that you are doing on the AMI ... I thot we were supposed to be seeing the same screen? | 06:33 |
| paulproteus | ...no. | 06:33 |
| paulproteus | That's not how SSH works. | 06:33 |
| paulproteus | We can *make* it work that way, but that's not the default. | 06:33 |
| ankitg | bleh, okie, I'll put them on the AMI | 06:34 |
| *** [mharrison] has joined #cc | 06:34 | |
| ankitg | right, I thot it was setup that way coz I mis-read something you wrote ... nvm, putting them there now ... | 06:34 |
| paulproteus | Cool. (-: | 06:35 |
| ankitg | I am assuming this should work :: scp -i ~/.ec2/id_rsa-pstam-keypair AWS_keys root@ ec2-75-101-255-228.compute-1.amazonaws.com:/root | 06:41 |
| paulproteus | You added a space. | 06:43 |
| ankitg | did I get something wrong, coz this is also going into an infinite loop of "give me a password" | 06:43 |
| paulproteus | root at space ec2 whatever | 06:43 |
| paulproteus | should be: root at ec2 whatever | 06:43 |
| paulproteus | Otherwise it looks okay to me. | 06:43 |
| ankitg | ah, okie, done | 06:44 |
| paulproteus | ankitg, I see what you mean about it not having a5 when looked-at from the AMI. | 06:45 |
| paulproteus | But shouldn't you be looking at the Varnish logs anyway? | 06:45 |
| paulproteus | Not that I see where those are stored, anyway. | 06:45 |
| ankitg | the i.creativecommons.org part is in apache/a5 ... | 06:45 |
| paulproteus | domU-12-31-39-00-B5-53 s3sync # ./s3cmd.rb list ccommons:/var/log/apache/a5/ | 06:46 |
| paulproteus | That works for me now. | 06:46 |
| paulproteus | But it didn't 30 seconds. | 06:46 |
| paulproteus | (ago) | 06:46 |
| paulproteus | "They must have changed something in the Matrix." | 06:46 |
| ankitg | it returned --------- to me ... and has been doing that for a while ... | 06:47 |
| paulproteus | Yes - retry? | 06:47 |
| paulproteus | I promise you that: | 06:47 |
| paulproteus | "They must have changed something | 06:47 |
| paulproteus | Er. | 06:47 |
| paulproteus | domU-12-31-39-00-B5-53 s3sync # ./s3cmd.rb list ccommons:/var/log/apache/a5/ | 06:47 |
| paulproteus | gives me output. | 06:47 |
| ankitg | just did ... same O_o )-: | 06:47 |
| paulproteus | Okay, type this: | 06:47 |
| paulproteus | screen -x | 06:48 |
| paulproteus | You'll now share my screen. | 06:48 |
| ankitg | domU-12-31-39-00-B5-53 s3sync # ./s3cmd.rb list ccommons:var/log/apache/a5 | 06:48 |
| ankitg | -------------------- | 06:48 |
| paulproteus | I have a slash before var. | 06:48 |
| paulproteus | I figured it by doing: | 06:48 |
| paulproteus | ./s3cmd.rb list ccommons: | 06:48 |
| *** jonico has joined #cc | 06:48 | |
| ankitg | but it works with the / upto apache O_o | 06:48 |
| ankitg | *withuot | 06:48 |
| ankitg | *s / wihuot / without | 06:49 |
| ankitg | ok, bad keyboard day. | 06:49 |
| paulproteus | I have 36h before my evaluation is due. | 06:49 |
| paulproteus | Well, thirty-six hours and ten minutes. | 06:49 |
| paulproteus | Just so you know. (-: | 06:49 |
| ankitg | but ./s3cmd.rb list ccommons:var/log/apache works and ./s3cmd.rb list ccommons:var/log/apache/a5 doesn't ... O_o | 06:50 |
| paulproteus | Listen. | 06:50 |
| paulproteus | S3 doesn't have actual paths. | 06:50 |
| paulproteus | Every filename is really just a name. | 06:50 |
| paulproteus | So there are files called literally "var/log/apache/a4/access.log.whatever.gz" | 06:50 |
| paulproteus | and also "/var/log/apache/a5/whatever/else/access.log.whatever.gz". | 06:50 |
| paulproteus | But those are just names, and they have a different first character. | 06:50 |
| paulproteus | It must be some ridiculous typo in nkinkade's upload scripts. | 06:51 |
| ankitg | okie, understood. | 06:51 |
| paulproteus | (-: | 06:51 |
| paulproteus | I'm sorry if I come off too patronizing. | 06:51 |
| ankitg | not at all ... the darn thing makes sense now. (-: | 06:52 |
| paulproteus | Great. (-: | 06:52 |
| *** jonico has quit IRC | 06:53 | |
| ankitg | okie, thanks for all the trouble-shooting ... now I go make those python scripts usable and run them ... | 06:53 |
| paulproteus | Sure - ping me when you need me. | 07:07 |
| *** Roderick__ has joined #CC | 08:43 | |
| *** Roderick__ has joined #CC | 08:44 | |
| *** Roderick_ has quit IRC | 08:56 | |
| *** Roderick_ has joined #CC | 09:08 | |
| *** Ekushey has joined #cc | 09:11 | |
| *** Roderick__ has quit IRC | 09:27 | |
| *** ereslibre has joined #cc | 09:46 | |
| *** Ekushey- has joined #cc | 10:03 | |
| *** Roderick__ has joined #CC | 10:15 | |
| *** Ekushey has quit IRC | 10:24 | |
| *** Roderick_ has quit IRC | 10:33 | |
| *** Ekushey- has quit IRC | 11:22 | |
| *** Roderick_ has joined #CC | 11:49 | |
| *** Roderick__ has quit IRC | 12:07 | |
| *** BobChao_ is now known as BobChao | 12:42 | |
| *** sama has joined #cc | 12:45 | |
| *** sama has quit IRC | 14:20 | |
| *** skxpl has quit IRC | 14:43 | |
| *** skxpl has joined #cc | 14:49 | |
| *** sama has joined #cc | 15:07 | |
| *** mlinksva has joined #cc | 15:07 | |
| *** isforinsects has quit IRC | 15:27 | |
| *** isforinsects has joined #cc | 15:29 | |
| *** mlinksva has quit IRC | 15:42 | |
| *** BobChao has quit IRC | 15:49 | |
| *** BobChao has joined #cc | 16:08 | |
| *** balor has joined #cc | 16:44 | |
| *** ereslibre has quit IRC | 16:49 | |
| *** skyfalle_ is now known as skyfaller | 16:49 | |
| *** isforinsects has quit IRC | 17:13 | |
| *** isforinsects has joined #cc | 17:15 | |
| *** [mharrison] has quit IRC | 17:18 | |
| *** BobChao has quit IRC | 17:24 | |
| *** isforinsects has quit IRC | 17:32 | |
| *** isforinsects has joined #cc | 17:47 | |
| *** Danny_B has quit IRC | 17:53 | |
| *** _Danny_B_ has joined #cc | 17:54 | |
| *** _Danny_B_ is now known as Danny_B | 17:54 | |
| *** ereslibre has joined #cc | 18:09 | |
| *** ircltrox-NL has joined #cc | 18:24 | |
| *** BobChao has joined #cc | 18:25 | |
| *** ircltrox-NL has quit IRC | 18:33 | |
| * ankitg has to reboot now ... too many things not responding ... | 18:50 | |
| *** ankitg has quit IRC | 18:50 | |
| *** BobChao has quit IRC | 19:14 | |
| *** ankitg has joined #cc | 19:15 | |
| *** balor has quit IRC | 19:42 | |
| *** sama has quit IRC | 20:32 | |
| *** Zero-One has joined #cc | 20:34 | |
| Zero-One | Hi there! | 20:34 |
| *** Zero-One has quit IRC | 20:36 | |
| *** ftobia has joined #cc | 21:07 | |
| *** isforinsects has quit IRC | 21:33 | |
| *** ftobia has quit IRC | 22:03 | |
| *** ereslibre has quit IRC | 23:23 | |
| paulproteus | ankitg, Howdy. | 23:23 |
| paulproteus | ankitg, I can solve your problem re: stdout. | 23:24 |
| *** mlinksva has joined #cc | 23:31 | |
Generated by irclog2html.py 2.6 by Marius Gedminas - find it at mg.pov.lt!