Log of the #blacklight channel on chat.freenode.net

Using timezone: GMT-05:00
* anarchivist leaves00:13
* bess leaves00:14
* erikhatcher joins08:29
* rduplain joins08:34
* Naomi joins08:35
* Guest13156 leaves08:57
* ndushay joins09:18
* ndushay leaves09:57
* jamieorc joins10:29
* bess joins10:33
* bess leaves10:36
* erikhatcher leaves10:38
* erikhatcher joins10:40
* ndushay joins10:57
* ndushay leaves11:13
* bess joins11:26
* erikhatcher leaves12:00
* erikhatcher joins12:04
* erikhatcher leaves13:06
* Nelis joins13:11
Good evening from Holland13:13
<bess>Hi, Nelis
Good morning from California. :)
* erikhatcher joins13:14
<Nelis>I'm experimenting with backlight, nice piece of work!
<bess>awesome! 13:15
<Nelis>But I'm gettnig stuck on highlighting
<bess>What's going on?
<Nelis>It is no option at the moment?
<bess>Ah, no, we don't have highlighting built in right now
but it shouldn't be hard to implement if you want it
<Nelis>AHA
<bess>you just have to add the hl fields to your solr request13:16
<Nelis>It has performance issues?
That's all?
<bess>Yes, it does for very large documents, but it shouldn't be a problem for smaller ones
you'll have to experiment and see how well it works for your collection13:17
do you know how to add highlighting to your solr request?
* erikhatcher_ joins
<Nelis>Thank you Bess
<bess>hey, erikhatcher_
no, problem, Nelis! Come back and hang out with us anytime!
<Nelis>All right, I'll be back (they say in California? ;-)13:18
* erikhatcher leaves13:19
* anarchivist joins
<erikhatcher>oh, hi!13:22
has anyone had issues with spell checking in blacklight / solr 1.4?13:23
<bess>erikhatcher: I haven't tried it, sorry.
<erikhatcher>bess: i meant to mention it last week.... i fired up the blacklight during the c4l10 session, pointed it at trunk (not 1.4, sorry) Solr and got an error with spell checking response13:24
everything else worked fine
* anarchivist leaves13:41
* anarchivist joins13:44
<Nelis>hmm I seem to have encountered an error... 13:49
How do i add th hl fields to my solr rezuest in BL?13:50
<erikhatcher>Nelis: you can add them to your request handler mapping in solrconfig.xml
Nelis: but will the UI display them by default? that's the question i have13:52
<Nelis>I have, but no show... 13:53
<cbeer_>i doubt the UI would display them -- i think you'd have to override the show/index partials.. or do some weird mappings
that said, the hl fields probably aren't in the SolrDocument either, right? 13:54
<Nelis>The HL comes out fine from Solr
nope13:56
* bess leaves
<cbeer_>let me add a hl field to my solr config..
<erikhatcher>BL ought to show highlighted fields by default.13:57
<cbeer_>erikhatcher: but SolrDocument just gets the //response/docs fields13:58
<erikhatcher>cbeer_: sounds like SolrDocument needs work ;)13:59
there needs to be less between the Solr response and the UI to allow this type of thing to pass through, pieces in the response linked to the documents
<cbeer_>well, let me get my stuff into place to actually verify it works the way i think it does14:01
<erikhatcher>consider also the debugQuery=true output, where scoring explanations are linked into a different section of the response -that's handy for the UI to show (optionally) too14:02
<cbeer_>isn't there a substantial performance hit with debugQuery?
<erikhatcher>cbeer_: it's not very substantial, no14:09
not even noticeable. faceting and highlighting consume the bulk of the response time, even querying when it's Stanford-like queries!
<cbeer_>awesome
ok, at least i have content in the hl fields now.. 14:13
<Nelis>cbeer_: In BL?14:14
<cbeer_>no, just solr. i didn't have highlighting configured 14:15
<Nelis>I have content in HL fields, but not in BL
Ah ok
* bess joins14:17
<erikhatcher>cbeer_: you have possibly the coolest conference URL: http://code4lib.org/conference/2010/beer14:18
<cbeer_>:)
* rsinger leaves14:24
<cbeer_>well, this is what seems to work if you override _document_list.html.erb;14:26
<div><%= @response['highlighting'][document.get(:id)]['content'].join(' ') unless @response['highlighting'][document.get(:id)].blank? %></div>
ew.
maybe there is a better way to do it using rsolr or by adding some mixin to Blacklight.solr 14:27
<erikhatcher>cbeer_: cool deal, that's not so bad. just need a helper method to do something cleaner <%=field_with_highlighting(document, 'content') %>14:29
or something like that
<cbeer_>erikhatcher: that's what i'd probably do -- the alternative looks like adding something to rsolr-ext in http://github.com/mwmitchell/rsolr-ext/tree/master/lib/rsolr-ext/response/
<erikhatcher>and i'd change the join to use '...' instead of ' ', just to show they are disconnected snippets
* rsinger joins14:30
<cbeer_>well, that's as far as i
'm going to go poking today.. maybe something for the end of the month though14:31
<Nelis>ok, thanks cbeer_ ! Haven't got it working yet, but now i know some direction ;-)14:32
<cbeer_>Nelis: I can toss together a gist of the things i did14:33
<Nelis>you may have noticed my lack of Ruby knowledge; but I'm learning!
Any help is appreciated
<cbeer_>Nelis: http://gist.github.com/31983414:41
* anarchivist leaves
* anarchivist joins
<erikhatcher>cbeer_: you may want that field_with_highlighting to return the full field value when no highlighting is present14:42
<cbeer_>erikhatcher: good idea
<Nelis>GREAT cbeer_! 14:43
I ow you a beer!14:44
<cbeer_>erikhatcher: actually, that probably should be ui logic -- field_with_highlighting([...]) || document.get([...])
<erikhatcher>cbeer_: a helper is UI logic too ;) IMO14:45
<cbeer_>erikhatcher: at least if i were to do this, i'd throw field_with_highlighting against a fulltext dump
<erikhatcher>yeah, but you're also unlikely to have a fl=fulltext
<cbeer_>point.
Nelis: if you get stuff working, would you mind sending an email to the blacklight list about all of this? 14:46
<Nelis>I will
<cbeer_>Nelis: are you Roland?15:12
<Nelis>yes15:13
<cbeer_>good -- i was worried for a moment that two people wanted to know about highlighting
<Nelis>just me
<erikhatcher>cbeer_: you going to reply to that e-mail thread?15:19
<cbeer_>erikhatcher: probably ought to, but i'm not sure i'll get to it today (though maybe tonight... )15:22
* rduplain leaves15:59
* erikhatcher leaves16:31
* erikhatcher joins16:36
* erikhatcher leaves16:47
<Nelis>Back again, with a highlighted field (and a beer) ;-)16:50
<bess>Nelis++ # hooray!
<Nelis>YES, verry rough but ok, my docs are too big16:51
long time wait for results
<cbeer_>Nelis: are you using term vectors and all that stuff?16:56
<Nelis>yes
switch it of will be my next effort i guess16:57
still slow 17:05
Problem is that facetted search errors when no keywords are supplied.
<cbeer_>erikhatcher probably knows some tricks.. probably involves tuning all the term* stuff and throwing memory at it
<Nelis>yes i have to tune the index, which is also in a verry rough condition ....17:06
* bess leaves17:08
<Nelis>I have an index made out of large documents, those can be devided in smaller units.17:09
<cbeer_>hm.. Blacklight::SolrHelper.solr_doc_params seems to drop extra_controller_params.. i wonder if there is a reason for that17:20
<Nelis>cbeer_: extra_controller_params is where to implement HL ? 17:32
<cbeer_>Nelis: maybe.. i'm now working on morelikethis stuff, though17:33
* anarchivist leaves17:49
* bess joins17:57
<Nelis>Does anybody here have experience with solritas? http://www.lucidimagination.com/blog/2009/11/04/solritas-solr-1-4s-hidden-gem/19:09
* bess leaves19:32
* anarchivist joins19:43
* Nelis leaves19:47
* jamieorc leaves19:59
* bess joins20:14
* bess leaves20:25
* cbeer leaves20:29
* wlayton joins21:25
* cbeer joins21:51
* wlayton leaves22:03
* g8tor_ joins22:23
* ndushay joins23:33

Generated by Sualtam