Monday, 2010-11-01

*** bassel has joined #cc00:23
*** jgay has joined #cc00:34
*** bassel has quit IRC00:36
*** mlinksva has quit IRC00:36
*** bassel has joined #cc00:45
*** bassel has quit IRC01:11
*** mlinksva has joined #cc01:32
*** thisisparker__ has joined #cc03:37
*** thisisparker_ has quit IRC03:40
*** mlinksva has quit IRC04:04
*** JED3 has joined #cc04:54
*** erlehmann has joined #cc06:57
*** wormsxulla has quit IRC07:15
*** wormsxulla has joined #cc07:31
*** thisisparker__ has quit IRC08:57
*** tantek has joined #cc08:58
*** thisisparker__ has joined #cc09:24
*** thisisparker__ is now known as thisisparker10:04
*** bassel has joined #cc10:10
*** Kaetemi has joined #cc10:54
*** jgay has joined #cc11:25
*** bassel has quit IRC11:37
*** tantek has quit IRC12:04
*** kreynen has joined #cc12:19
*** kreynen has quit IRC12:27
*** erlehmann has quit IRC12:27
* danbri wonders if there's a CC connection --
*** oshani has joined #cc12:48
*** Kaetemi has quit IRC12:55
*** kreynen has joined #cc13:07
*** oshani has quit IRC13:21
*** erlehmann has joined #cc13:29
*** oshani has joined #cc13:30
*** bassel has joined #cc13:41
*** jgay has quit IRC14:03
*** tantek has joined #cc14:34
*** nkinkade has joined #cc15:09
*** mlinksva has joined #cc15:16
*** jgay has joined #cc15:28
*** oshani has quit IRC15:48
*** erlehmann has quit IRC15:55
*** mlinksva has quit IRC16:01
*** erlehmann has joined #cc16:09
*** balleyne has joined #cc16:20
*** danbri has quit IRC16:23
*** mralex has joined #cc16:41
*** akozak has joined #cc16:44
*** oshani has joined #cc16:47
*** danbri has joined #cc16:51
*** danbri has joined #cc16:51
*** JED3 has quit IRC17:11
*** bassel has quit IRC17:30
*** bassel has joined #cc17:39
*** thisisparker has quit IRC17:41
*** jgay has quit IRC17:46
*** JED3 has joined #cc17:49
*** tantek has quit IRC17:55
akozakugh, nkinkade I have an embarrassing request: could you reset my password on linode? I seem to have forgotten what I changed it to after that security issue a few weeks ago18:06
akozaknot urgent18:06
nkinkadeakozak:  Look in /home/akozad/password18:08
nkinkadeOf course, change that password, and you may as well delete that file too.18:09
akozakok thank you nkinkade, done18:09
*** bassel has quit IRC18:58
*** bassel has joined #cc19:01
*** tantek has joined #cc19:15
*** tantek has quit IRC19:17
*** mralex1 has joined #cc19:18
*** jgay has joined #cc19:29
*** thisisparker has joined #cc19:48
*** jgay has quit IRC19:55
*** Kaetemi has joined #cc20:04
*** wormsxulla has quit IRC20:13
*** balleyne has quit IRC20:19
akozaknkinkade, I think the CC Staff Call Bot is offset by a week.20:19
akozakIt just created a page for 11-1020:20
nkinkadeakozak: Is there a problem with that?20:21
nkinkadeThe email that went out seems right to me.20:21
akozaknkinkade, yea it's pretty inconsequential20:22
nkinkadeakozak: How did you notice that it had created one for 11-10?  Recent changes?20:22
nkinkadeWhere does it show that the staff call bot made that change?20:23
nkinkadeWhat it a long time ago?20:23
akozaknkinkade, no it just happened, make sure you have "Show bots" on20:24
nkinkadeI'll look at the code.20:25
*** wormsxulla has joined #cc20:27
*** i386nix has joined #cc20:32
i386nixi have float result; int value=569; result=(value/200);printf("%.2f",result); and i get 2.00 as a result as opposed to 2.84, why??20:33
*** i386nix has left #cc20:34
nkinkadeOkay.  I think the code should now be updated to only try to create pages bi-weekly instead of every week for the staff call.20:37
akozaknkinkade, cool. i thought it had been doing that already though, just the wrong week cycle.20:39
nkinkadeakozak: It was doing that already for sending out the emails, but apparently not with regard to creating the following week's page in advance.20:40
nkinkadeThanks for pointing that out.20:40
akozakoh ok. thanks nkinkade20:40
*** lotia has quit IRC20:41
*** bassel has quit IRC21:12
*** bassel has joined #cc21:14
mralexJED3: what's the canonical cc engine module in version control?21:42
JED3mralex: cc.engine?21:43
mralexJED3: in svn or git?21:43
JED3is that what you're asking?21:43
JED3oh git21:43
JED3nkinkade: ping21:43
nkinkadeJED3: ?21:43
JED3nkinkade: we're currently not rotating the vhost apache logs on, however the deedscraper is currently logging to 2 directories /var/log/deedscraper and the apache2 log dir21:45
nkinkadeJED3: We are rotating the scraper logs.21:45
nkinkadeI set that up last week.21:45
JED3nkinkade: are you sure its rotating /var/log/apache2/* ?21:46
nkinkadeJED3: No, you're right, not that one, but /var/log/deedscraper21:46
JED3yeah... so the access log that we need is actually in the apache dir21:47
nkinkadeI didn't know there was anything useful in the Apache one.21:47
nkinkadeBut we can do that one too.21:47
JED3there is a file called access.log in the deedscraper dir, but its useless, an artifact from when we were using paste to serve up the api21:47
nkinkadeCool.  Well, the Apache access.log should be rotated by default, but I can start archiving it too.21:48
nkinkadeJED3: Is it possible to log everything to the the Apache log dir for that vhost?21:49
JED3nkinkade: hmm yes, but, we might run into issues with permissions21:49
nkinkadeJED3: Logrotate can set whatever permissions we want on the new logs.21:50
nkinkadeUser, mode, etc.21:50
JED3the deedscraper needs to have the same suexec permissions as the scraper process, and the apache dir needs to be writable by apache21:50
nkinkadeJED3: Actually Apache doesn't need write access ... all that is done as root.21:51
JED3nkinkade: yeah, but apache wont be able to write to a directory thats john:users 744, and the scraper will fail if its logging directory are set to anything other than those permissions21:51
nkinkadeJED3: I'm pretty sure that Apache logs as root, not www-data.21:52
nkinkade/var/log/apache2 is owned by root, as well as all the subdirectories.21:52
JED3nkinkade: if thats true than it should be fine21:52
JED3ahh okay21:52
JED3lets try that then21:52
nkinkadeJED3: Let's give it a go, because having all the logs in one place will make this easy, as well as keep the structure of the archive directories.21:52
JED3should we reconfigure apache or deedscraper, which directory do you prefer?21:53
nkinkadeI guess we want to make sure that deedscraper/access.log doesn't clobber the Apache one.21:53
JED3nkinkade: i agree, which is why i brought this up21:53
JED3i was going to go the sloppy route, but figured i better run it by you ;)21:53
JED3nkinkade: yes thats another thing21:53
nkinkadeJED3: It would be nice if everything was logged to /var/log/apache2/scraper.creativecommons.org21:53
JED3i think i can removed the access.log configuration bit from the scraper21:54
JED3nkinkade: then that directory will need to be john:users 74421:54
JED3can we do that?21:54
nkinkadeThat is, in there to have the normal Apache access.log and error.log but also have the metadata-scraper.log.21:54
nkinkadeJED3: I'll set that up right now.21:54
JED3i need to set up a separate vhost (and dns entry) for the testing version of the scraper21:56
nkinkadeJED3: On second thought, I wonder if just using a symlink would be best?21:56
JED3nkinkade: :/ i think it'd be simpler all in 1 directory if its possible21:57
nkinkadeMaking this work with john:users would require two separate logrotate scripts .. one for the scraper, and another for every other vhost.21:57
nkinkadeThe Apache logrotate script operates on /var/log/apache2/*, but we only care about  It's the only dir in there now, but it's possible that it won't always be.21:58
JED3nkinkade: yah, i am about to add a new vhost right now...21:58
nkinkadeJED3: What's the new vhost for?21:59
JED3a staging version of the scraper21:59
JED3i get nervous touching the production scraper21:59
nkinkadeJED3: Ah. Okay.22:00
*** Auria has joined #cc22:01
JED3speaking of which which is most preferable as its subdomain: - - ?22:01
nkinkadeJED3: You don't think that something like this would okay:22:02
nkinkade$ sudo ln -s /var/log/deedscraper/metadata.log /var/log/apache2/
JED3or :P22:02
nkinkadeAnything you like, really.22:02
JED3crapper it is then22:02
nkinkadeBut how about the above symlink?22:02
JED3nkinkade: i think that should work22:02
nkinkadeI guess then rsync will have to dereference symlinks.  Hmm.22:03
JED3as long as its linked from apache to deedscraper like you have above22:03
nkinkadeJED3: I guess the way we were doing it on a5 was fine, with the exception that we'll just need to know that the access.log that matters is the one in the Apache vhost.22:04
nkinkadeThe more I think about it, keeping this separate from Apache seems sort of nice, especially considering the issue of permissions.22:05
akozaknkinkade, do you mind if I assign a non-urgent request to upgrade maps/sem maps on the wiki to you?22:09
JED3okay, so can we just rotate on both directories, and change the rsync to only grab /var/log/deedscraper/metadata* and /var/log/apache2/*22:10
*** Auria has left #cc22:10
JED3 i may get shit for this but i dont give a poot (puns absolutely intended)22:12
nkinkadeJED3: Yeah, that sounds right.  I'll limit the metadata rsync to only grab the metadata.log.22:16
JED3nkinkade: awesome, thx22:16
*** oshani has quit IRC22:20
akozakmralex, relevant to cc search?  maybe not since they already seemed to support api calls for cc licenses22:22
akozakunless the new cse api tools helps somehow22:22
mralexmight be able to add a more integrated search experience on cc.org22:23
akozakah yea22:23
akozakthat too22:23
akozakjson output now for cse22:23
akozakwow the default limit for the custom search api is 100 queries a day22:26
JED3Default limit: 100 queries/day22:26
JED3ha yeah..22:26
JED3just saw that myself22:27
akozakafter that youve gotta find it your own damn self22:27
JED3i'm surprised they arent selling credits22:28
nkinkadeJED3: Are you doing something with /apps/deed?22:30
nkinkadeJust a message it was down.22:30
nkinkadeJust being sure.22:30
JED3nkinkade: yes22:40
*** thisisparker has quit IRC23:14
*** jgay has joined #cc23:17
*** jgay has joined #cc23:17
*** oshani has joined #cc23:25
*** jgay has quit IRC23:55
*** jgay_ has joined #cc23:55
*** erlehmann has quit IRC23:55

Generated by 2.6 by Marius Gedminas - find it at!