Solr 4.8 Features Overview
Lets add a new synonym:
Before these changes are visible to the actual search or indexing code in Solr, we need to reload the Solr core:
And now we can do a query on a field that matches the dynamicField we set up and can see the results of the new synonym:
To delete the stopword we just added:
Complex Phrase Queries
The
It works via multiple passes, parsing a query and then re-parsing any phrase queries for additional markup. At query execution time, span queries are generated to implement the complex phrase logic.
complexphrase query parser can produce phrase queries with embedded wildcards and boolean queries.It works via multiple passes, parsing a query and then re-parsing any phrase queries for additional markup. At query execution time, span queries are generated to implement the complex phrase logic.
The simplest example is a phrase query containing a prefix query:
q={!complexphrase}"apple ip*" |
This will match text with both “apple ipod” and “apple ipad”.
One can specify
One can specify
inOrder=false as a localParam to also match “ipod apple” and “ipad apple”.q={!complexphrase inOrder=false}"apple ip*" |
One can also specify a different default field to search with the
df localParam:q={!complexphrase df=name}"john* smith" |
This will match both “john smith” and “johnathan smith” in the
name field. Of course one could always specify the field directly in the query as well:q={!complexphrase}name:"john* smith" |
Phrase slop works to specify the proximity of the clauses. For example, the following would also match a name of “johnathan q smith”:
q={!complexphrase}name:"john* smith"~1 |
And of course we can throw in parens, OR clauses, and other complex logic as well:
q={!complexphrase}name:"(aaa OR (bbb* OR ccc)) ddd -eee (fff~1 OR ggg)" AND text:"nnn? (ooo OR ppp) -qqq www"~3 |
Indexing Child Documents in JSON
Named Config Sets
This is more in the “configuration” category of features. SolrCloud has always allowed multiple collections to share configuration, and now that capability has been brought to Solr’s non-cloud mode.
Named Config Sets
This is more in the “configuration” category of features. SolrCloud has always allowed multiple collections to share configuration, and now that capability has been brought to Solr’s non-cloud mode.
Since collections can be created or destroyed, we obviously don’t want shared configuration for these collections to be under the collection itself. The default location for config sets is in the “configsets” directory under the solr home (the example solr server currently doesn’t have this directory by default).
Stopwords and Synonyms REST API
Stopwords and Synonyms may now be managed via a REST API!
The new analysis filter types are ManagedStopFilterFactory and ManagedSynonymFilterFactory.
The example schema.xml now contains a field type that uses these new analysis filters:
The new analysis filter types are ManagedStopFilterFactory and ManagedSynonymFilterFactory.
The example schema.xml now contains a field type that uses these new analysis filters:
<!-- A text type for English text where stopwords and synonyms are managed using the REST API --><fieldType name="managed_en" class="solr.TextField" positionIncrementGap="100"> <analyzer> <tokenizer class="solr.StandardTokenizerFactory"/> <filter class="solr.ManagedStopFilterFactory" managed="english" /> <filter class="solr.ManagedSynonymFilterFactory" managed="english" /> </analyzer></fieldType> |
To test this out, let’s also change the dynamic field
*_en to use managed_en:<dynamicField name="*_en" type="managed_en" indexed="true" stored="true" multiValued="true"/> |
Synonyms
After starting the example server, we can retrieve the current english synonyms:
[...] "managedMap":{ "gb":["gib", "gigabyte"], "happy":["glad", "joyful"], "tv":["television"]}}} |
Lets add a new synonym:
curl -XPUT "http://localhost:8983/solr/collection1/schema/analysis/synonyms/english" -H 'Content-type:application/json' --data-binary '{"mb":["MiB","megabyte"]}' |
Before these changes are visible to the actual search or indexing code in Solr, we need to reload the Solr core:
And now we can do a query on a field that matches the dynamicField we set up and can see the results of the new synonym:
[...] "debug":{ "rawquerystring":"foo_en:mb", "querystring":"foo_en:mb", "parsedquery":"(foo_en:megabyte foo_en:mib)/no_coord", "parsedquery_toString":"foo_en:megabyte foo_en:mib", |
To delete the stopword we just added:
Stopwords
To retrieve the list of stopwords:
To add a new stopword:
curl -XPUT "http://localhost:8983/solr/collection1/schema/analysis/stopwords/english" -H 'Content-type:application/json' --data-binary '["foo"]' |
To delete the stopword we just added:
Other changes
There have been numerous SolrCloud changes, including:
- A new List collections and cluster status API which clients can use to read collection and shard information instead of reading data directly from ZooKeeper.
- Some long running SolrCloud commands (like shard splitting) may now be run in “async” mode to avoid client timeouts
- A new ADDREPLICA command in the Collections API
Other changes include:
- Solr 4.8 now requires Java7!
- RegexReplaceProcessorFactory now supports pattern capture group substitution in the replacement string.
- A DocExpirationUpdateProcessorFactory that can mark documents based on a TTL (time-to-live) and periodically delete expired documents
No comments:
Post a Comment