Thursday, 2010-10-28

*** uessebe has joined #cc00:00
*** JED3 has quit IRC00:04
*** kreynen has joined #cc00:19
*** uessebe has quit IRC00:28
*** mralex has quit IRC00:32
*** oshani has quit IRC00:58
*** thisisparker has joined #cc01:05
*** kreynen has quit IRC02:46
*** thisisparker_ has joined #cc02:56
*** largo has quit IRC02:58
*** largo has joined #cc02:59
*** thisisparker has quit IRC02:59
*** JED3 has joined #cc03:02
*** bassel has joined #cc06:38
*** danbri has quit IRC07:25
*** danbri has joined #cc07:30
*** danbri has joined #cc07:30
*** bassel has quit IRC07:50
*** Kaetemi has quit IRC08:12
*** tlk has joined #cc08:19
tlkHello, any chance that GNU AGPLv3 is explained for humans ala ?08:20
*** bassel has joined #cc08:37
*** JoiIto1 has joined #cc08:41
*** JoiIto has quit IRC08:42
*** bassel has quit IRC09:38
*** JoiIto1 has quit IRC10:12
*** JoiIto has joined #cc10:12
*** Kaetemi has joined #cc11:02
*** Kaetemi has quit IRC11:24
*** thisisparker_ has quit IRC11:27
*** iboB has quit IRC11:42
*** Guest52176 is now known as cB11:47
*** cB is now known as Guest853611:48
*** thisisparker_ has joined #cc12:33
*** kreynen has joined #cc12:39
*** tvol has joined #cc12:39
*** tvol has quit IRC13:13
*** tvol has joined #cc13:13
*** wormsxulla has quit IRC13:17
*** wormsxulla has joined #cc13:17
*** oshani has joined #cc13:37
*** oshani has quit IRC13:43
*** kreynen has quit IRC13:53
*** oshani has joined #cc13:58
*** Kaetemi has joined #cc14:01
*** danbri has quit IRC14:22
*** paroneayea has quit IRC14:30
*** paroneayea has joined #cc14:37
*** oshani has quit IRC14:39
*** paroneayea has quit IRC14:42
*** oshani has joined #cc14:46
*** oshani has quit IRC14:55
*** erlehmann has joined #cc15:26
*** paroneayea has joined #cc15:26
*** akozak has joined #cc15:28
*** paroneayea has quit IRC15:30
*** paroneayea has joined #cc15:31
*** kreynen has joined #cc15:39
*** mralex has joined #cc16:52
*** oshani has joined #cc16:53
*** oshani has quit IRC17:02
*** oshani has joined #cc17:03
*** JED3 has quit IRC17:07
*** DNS777 has quit IRC17:09
*** DNS777 has joined #cc17:12
*** oshani has quit IRC17:28
*** oshani has joined #cc17:31
nkinkademralex: How fast does this page load for you?
*** JED3 has joined #cc17:44
mralexnkinkade: not very fast17:44
nkinkademralex: It barely loads at all for me ... it might after 3 or 4 minutes.17:45
nkinkadeI don't know what's going on here.  I don't have this problem on the live site, just on staging.17:45
mralexnkinkade: apache benchmark gives me an average of 1s to load over 10 requests17:45
nkinkademralex: So ab loads its quickly, but your browser doesn't?17:46
mralexnkinkade: brwoser appears to be mostly slow in loading the css and js17:47
nkinkadeHmm.  There is a Varnish rule to pass() all requests to  I just changed that to a pipe() and it seems quick now.17:47
mralexit's about as fast as staging usually is now.17:47
*** thisisparker_ has quit IRC17:56
*** DNS777 has quit IRC17:56
*** DNS777 has joined #cc17:58
JED3paroneayea: woot, the new metadata js works17:58
JED3nkinkade: we need to set up a redirect for to, but other than that we can disable the scraper service on a517:59
JED3... if you havent already17:59
nkinkadeJED3: No, I haven't.  Is the redirect for those who may be using the service independent of the deeds?18:00
*** tvol has quit IRC18:00
JED3nkinkade: yes18:01
paroneayeaJED3: jawesome18:02
nkinkadeparoneayea: JED3: How do we coordinate this transition?  Is the only thing that needs to happen is pushing the changes to cc.engine live, then clearing the deed cache, then adding the redirect?18:07
paroneayeankinkade: yes afaik18:07
JED3nkinkade: the redirect doesnt need to be done right now18:08
nkinkadeJED3: Why's that?18:08
nkinkadeWhat does the redirect need to look like?18:08
JED3just merge cc.engine's next into master and clear the deed cache18:08
nkinkadeJED3: Do you want to implement that redirect?18:08
JED3nkinkade: the deed's wont be referencing the old path anymore18:08
JED3they'll point to
JED3nkinkade: and yes i can add the redirect today18:09
paroneayeaJED3: is it ready for golive?18:09
* paroneayea makes some tea, brb18:09
JED3paroneayea: yes, i just pushed a commit to next that needs to be merged first18:09
JED3... on cc.engine18:09
nkinkadeI'm ready whenever you guys are, but it seems that there's not much for me to at this point.18:09
paroneayeaJED3: okay18:09
*** mlinksva has joined #cc18:17
mralexnkinkade: mlinksva: err, it appers is down.18:17
nkinkademralex: I think it's the massive amount of traffic from this mailing that just happened.18:18
mlinksvareally? find it hard to believe the letter could generate massive traffic18:18
JED3i cant ssh in18:18
mlinksvaanyway, that's why i'm here now.18:18
JED3nkinkade: is a9 reachable for you?18:19
nkinkadeJED3: I'm logged in, but it's brutally slow.18:19
JED3nkinkade: sigh, has serverbeach reported any issues in the past few days?18:20
JED3i noticed a7 just a few moments ago as being incredibly unresponsive18:20
nkinkadeJED3: Not that I know of, why?18:20
*** mattl has joined #cc18:24
mattlparoneayea: fix your database.18:24
*** oshani has quit IRC18:25
paroneayeamattl: my database?18:25
mattlDB_DataObject Error: DB Error: connect failed18:25
paroneayeankinkade: JED3: ^^18:26
mralexmattl: we're aware of the problem18:26
mattli'm making you extra aware of it.18:26
*** thisisparker_ has joined #cc18:26
paroneayeaJED3: for obvious reasons I am going to delay deploying that new code to until is not a problem18:30
paroneayeaand since I don't know much about, I guess I'm staying out of that.18:30
*** oshani has joined #cc18:30
JED3paroneayea: ok thx18:30 is the openid thing, right? so, for whatever reason, i assume because my membership expired, but my openid just kinda stopped working one day.18:31
mattli don't remember actually getting any kind of email about that, but maybe i just missed it.18:31
paroneayeamattl: moved from a django codebase to entirely civicrm this year, and some openid stuff broke iirc18:32
JED3mattl: most likely your account expired, i can tell you definitively once we get this machine back up :/18:32
paroneayeaJED3 knows more about it though18:32
paroneayeaor expired, you know :)18:33
JED3paroneayea: the openid stuf that "broke" is back to the same level of what did and didn't work before the rework18:34
mattlJED3: awesome. yeah, get the machine back up first :)18:34
JED3paroneayea: any site that uses that gd dotnetopenid library fails when trying to auth with our openid provider18:34
JED3...most notably stackoverflow, which we get plenty of complaints about :/18:35
paroneayeaJED3: ah, sux18:36
* JED3 releases his breath 18:47
JED3a9 is back up18:47
mlinksvak, what was the problem?18:47
JED3nkinkade: found "zend_mm_heap corrupted" in the apache logs right as things started to blow up18:51
nkinkadeJED3: Hmm.18:51
nkinkadeIt's not clear to me why 5K messages would cause a problem, when they haven't in the past.18:52
JED3that seems to me to indicate that there was a memory leak somewhere18:52
*** akozak has quit IRC19:20
paroneayeaJED3: so everything's clear and good on cc.net19:29
paroneayeathink it's fair to deploy on then?19:29
mlinksvaparoneayea, i think JED3 is at lunch19:29
paroneayeamlinksva: I will wait to deploy this metadata scraper stuff till he gets back then :)19:30
*** MarkDude has quit IRC19:30
*** oshani has quit IRC19:30
*** kreynen has quit IRC19:42
JED3paroneayea: hey20:05
paroneayeaJED3: yooooooo20:05
*** erlehmann has quit IRC20:06
JED3its go time20:06
paroneayealet's go20:09
*** oshani has joined #cc20:12
* paroneayea wipes the cache20:13
paroneayeawell all is running, but as expected, complete cache wipe has sloooow20:15
paroneayea but it's up20:15
mattlparoneayea: you changed it?20:16
paroneayeamattl: different rollout :D20:17
paroneayeawe moved the metadata scraper onto another machine, updated the deeds to reflect that20:17
paroneayeahas nothing to do with being down20:17
JED3click through to the deed20:17
paroneayeaJED3: looks grood20:17
JED3much faster now! another attractive aspect is that the scraper results can be cached clientside now :)20:18
JED3this should really lighten the load on a520:19
paroneayeasomeone hang up some inspirational posters, we are on a roll20:19
paroneayea|| o  o _o ||20:19
paroneayea|| Y  M  | ||20:19
paroneayea|| ^  ^  ^ ||20:19
paroneayea| TEAMWORK  |20:19
JED3paroneayea: i'm hovering over your new thinkpad right now20:35
JED3u like win7 right? half way through the install right now20:35
mattlJED3: make sure you put the full visual studio on there. he'll need that.20:36
paroneayeaJED3: ;p20:36
nkinkadeJED3: So the scraper itself is faster too?20:36
paroneayeaJED3: the choice between 32 bit and 64 bit windows was chosen by random.choice() :)20:37
paroneayeaserius bizness20:37
JED3nkinkade: yes i think so, since its not sharing network io with the rest of a520:37
nkinkadeJED3: Memory seems to be fine too on the new machine.20:38
JED3mattl: o i'll make sure of it20:38
*** akozak has joined #cc20:38
nkinkadeI guess I need to update Nagios to start monitoring the new server.20:38
nkinkadeJED3: This new machine handles /apps/triples and /apps/deed?20:38
JED3nkinkade: what level linode vpm is it?20:38
JED3nkinkade: yes20:38
JED3nkinkade: /apps/triples is pretty much deprecated at this point20:39
nkinkadeJED3: So we don't need to be monitoring it?20:39
JED3we should still monitor its status though20:39
nkinkadeBut it's on the new machine in any event, right?20:39
JED3nkinkade: yeah keep it in nagios, but point it at
JED3nkinkade: yes20:39
JED3nkinkade: is a5 still running the scraper process?20:40
nkinkadeJED3: I think so, otherwise Nagios would have complained by now. :-)20:40
JED3nkinkade: i'd like to run a quick benchmark against the two if it is20:40
JED3nkinkade: okay good20:40
nkinkadeJED3: I'll just let you disable it when you're ready.20:40
JED3ahh okay20:41
JED3nkinkade: so for this vm, can we expect that it will only be used for the scraper?20:41
JED3if so, i'd like to trade in apache for nginx20:42
nkinkadeJED3: I'm not sure there was/is any long term plan for it, just to get scraper off a5 ASAP.20:42
nkinkadeJED3: What big benefit will nginx bring for the scraper?20:42
JED3nkinkade: ahh okay, but if this is only a 1024 instance, there's no point in throwing more on it20:42
nkinkadeJED3: I guess I don't really mind, but you should probably run that by Nathan.20:43
nkinkadeMaybe by commenting the ticket for moving the scraper.20:43
JED3nkinkade: nginx won't do anything for the scraper in its current state, but i'm making some changes to the code of scraper that would make it less efficient when ran under apache20:45
nkinkadeJED3: Cool.  Like I say, that sounds like something to discuss with Nathan, but I have no problem with it.20:46
JED3nkinkade: yeah, i'd definitely run it by nry first, but beforehand i wanted to find out whether or not we were going to use the new server for anything else20:47
nkinkadeJED3: Not that I know of.20:48
JED3hey flickr finally removed the .../deed.xx from rel=license links20:53
JED3paroneayea: i also changed cc.engine_stage to a writable clone, just as fyi20:57
paroneayeaJED3: ?20:57
paroneayeanot sure what you meant there20:58
JED3paroneayea: it was a read-only clone of cc.engine20:58
JED3the cc.engine_stage directory on a720:58
JED3i need to push so i change the git configuration, and wasnt sure if you had it set to read-only for a reason. cant imagine why it would be but wanted to let you know that i changed it just in case20:59
JED3add some past tenses there: needed* changed*21:00
paroneayeaah got it21:05
mralexi have an uncommitted change to on cc.engine_stage, i can move it out of hte way if it's in the way.21:05
*** izdubar has joined #cc21:08
paroneayeamralex: kk21:11
mralexor, i guess, if it's in git just don't add it :)21:12
JED3hrrm, i guess i should have benchmarked while the scraper was still on a521:16
JED3paroneayea: can i make a slightly insane request?21:17
JED3paroneayea: i'm only bugging you because i'm not sure how to deal with reseting the file cache21:20
JED3but can we reset back before the js changes?21:21
*** akozak has quit IRC21:26
*** paroneayea has quit IRC21:26
*** rindolf has joined #cc21:27
*** akozak has joined #cc21:27
*** paroneayea has joined #cc21:27
*** rindolf has quit IRC21:27
*** rindolf has joined #cc21:28
*** rindolf has quit IRC21:59
*** izdubar has quit IRC22:01
*** CIA-61 has quit IRC22:07
*** phurl has quit IRC22:08
*** kreynen has joined #cc22:09
*** kreynen has quit IRC22:32
*** oshani has quit IRC22:38
*** kreynen has joined #cc22:41
JED3nkinkade: did you order more memory for the backups rack?22:47
nkinkadeJED3: Didn't you get the email to webmaster?22:47
nkinkadeJED3: Sorry.22:47
nkinkadeI was thinking you meant a9.22:47
nkinkadeJED3: Yes, more memory is on the way.22:47
nkinkadeShould be there today or tomorrow.22:48
JED3nkinkade: yup, sitting in my lap22:48
nkinkadeJED3: Care to drop it in the box?22:48
JED3nope not all, i'll do so now22:48
*** CIA-80 has joined #cc22:55
nkinkadeJED3: Would it also be possible to plug the machine in and make sure that the memory works and is registering?22:56
*** mattl has left #cc22:56
JED3nkinkade: yeah np, do you know if the orange room is wired for ethernet?23:00
JED3i cant seem to find a port anywhere23:00
nkinkadeJED3: Wait, is the orange room the tiny one?23:00
JED3the tiny one is green, the orange one is where we used to keep all the tshirts and mailing stuff23:01
JED3otherwise known as the "mail room" i guess23:01
JED3nkinkade ^23:02
nkinkadeJED3: Yeah, there is definitely a jack in there.  I think it's on the back left wall as you're walking in.23:02
JED3nkinkade: ahh okay, i think its been covered with the new file cabinets then23:03
*** largo has left #cc23:05
nkinkadeJED3: Does Apache need to be reloaded after the scraper logs are rotated?23:10
nkinkadeNo, right?23:10
JED3nkinkade: no, as long as the logs' directory is writable by john:users, then apache with just create a new file23:11
JED3will just*23:11
nkinkadeCool.  At the moment the logrotate conf file is reloading Apache.  I'll stop that.23:11
JED3nkinkade: i can't find any port in the orange room, there is an empty wall port, with a blank plastic plate on the far left wall?23:12
nkinkadeJED3: Hmm.  My most recent memory is working there with paroneayea last time I was in SF.  I thought it was back there.23:12
nkinkadeBehind the big metal shelf with the tshirts on ti.23:13
nkinkadeJED3: Could you just take it to another place in the office and plug it in?23:13
JED3haha, yeah nothing's there, mralex just helped me look to make sure i wasn't insane23:15
JED3the port that would have been where tshirts shelf used to be is now just a blank plastic face on the wall23:16
JED3but yeah i'll plug it in elsewhere23:16
JED3i only ask because the router doesn't have any available ports, so i have to unpload ani's hr machine, but thats fine for right now23:17
*** kreynen has quit IRC23:29
*** JoiIto has quit IRC23:31
nkinkadeJED3: Isn't there a wall jack by Ted's desk?23:37
JED3nkinkade: yes, but no openings avail23:37
nkinkadeTed's not using it right now, right?23:38
nkinkadeJED3: I'm not seeing the machine?23:40
JED3nkinkade: sorry got pulled away for a sec, its using the cable normally connected the HR PC23:41
*** JoiIto has joined #cc23:41
JED3nkinkade: how are you finding the machine anyhow? with nmap?23:41
nkinkadeJED3: The other day when you powered it up for me I configured an virtual interface (eth0:0) to be at
JED3nkinkade: odd, i'm not seeing it, how do i know whether or not it booted?23:46
JED3there's 3 green lights illuminated, and 1 blue one flashing...23:46
nkinkadeJED3: Perhaps it's running but has no eth connection?23:46
nkinkadeI even just tried setting a virtual int. on the office machine to the same net as the public IP of that new server, but still can't reach it.23:47
JED3doh, the ethernet cable needed to be pushed in by a hair23:47
nkinkadeHmm.  Still can seem to reach it.23:48
JED3hmm, there's green light coming from the network port, indicate its receiving packets right?23:48
nkinkadeThat should be right.23:49
JED3still a blinking blue light on the front though, blinking at an interval, not like an activity indicator23:49
nkinkadeJED3: I've got to run in a about 3 minutes.  The main thing is to make sure the machine booted, and also that the extra 2G are being seen, for a total of 3G ... before we ship it down to Redwood City.23:49
JED3nkinkade: sure, i'll check it23:50
nkinkadeThanks JED3!23:50
JED3thanks for the help today!23:50
JED3yeah no prob, have a good night23:50
nkinkadeWhat did I do?!23:50
nkinkadeI'm glad we got the scraper successfully moved.23:50
nkinkadeAnd I've also got log rotating and backups happening for the new machine, as well as Nagios monitoring.  I think we're set.23:51
nkinkadeJED3: The public IP of that machine should be, and the private IP
nkinkadeJust in case you get to configuring virtual interfaces. :-)23:52
JED3nkinkade: heh alrighty\23:54
JED3whatever, you saved a9!23:54
*** Danny_B has quit IRC23:54
*** nb has quit IRC23:57
JED3nkinkade: got it up, back had to connect a monitor, it stalled on the boot asking to confirm the eth interface conf23:57
*** JoiIto1 has joined #cc23:58
*** nb has joined #cc23:59

Generated by 2.6 by Marius Gedminas - find it at!