pkgsrc-Changes-HG archive

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]

[pkgsrc/trunk]: pkgsrc/databases/elasticsearch Update databases/elasticsearch...



details:   https://anonhg.NetBSD.org/pkgsrc/rev/9cefbb2d436d
branches:  trunk
changeset: 362306:9cefbb2d436d
user:      fhajny <fhajny%pkgsrc.org@localhost>
date:      Thu May 11 08:36:30 2017 +0000

description:
Update databases/elasticsearch to 5.4.0.

=== Breaking changes

Settings::
- Remove support for default settings


=== Breaking Java changes

Aggregations::
- Move getProperty method out of MultiBucketsAggregation.Bucket
  interface
- Remove getProperty method from Aggregations interface and impl
- Move getProperty method out of Aggregation interface

Java API::
- Fold InternalSearchHits and friends into their interfaces


=== Deprecations

Aggregations::
- Deprecate Stats#getCountAsString

Java API::
- Add BulkProcessor methods with XContentType parameter

Network::
- Deprecate Netty 3

Packaging::
- Add deprecation warnings for $ES_USER and $ES_GROUP

Plugin Delete By Query::
- Deprecate delete_by_query requests without an explicit query

Plugin Repository Azure::
- Deprecate global `repositories.azure` settings

Plugin Repository S3::
- Deprecate repositories.s3 settings

REST::
- Deprecate ldjson support and document ndjson for bulk/msearch

Stats::
- Deprecate `_field_stats` endpoint


=== New features

Analysis::
- Adds pattern keyword marker filter support
- Expose WordDelimiterGraphTokenFilter

Index APIs::
- Add FieldCapabilities (`_field_caps`) API

Search::
- Introduce incremental reduction of TopDocs

Similarities::
- Adds boolean similarity to Elasticsearch


=== Enhancements

Aggregations::
- Add BucketMetricValue interface
- Move aggs CommonFields and TYPED_KEYS_DELIMITER from
  InternalAggregation to Aggregation
- Use ParseField for aggs CommonFields rather than String
- Share XContent rendering code in terms aggs
- Add unit tests for ParentToChildAggregator
- First step towards incremental reduction of query responses

Allocation::
- Trigger replica recovery restarts by master when primary relocation
  completes
- Makes the same_shard host dynamically updatable

Analysis::
- Support Keyword type in Analyze API

Cluster::
- Prevent nodes from joining if newer indices exist in the cluster

Core::
- Detect remnants of path.data/default.path.data bug
- Await termination after shutting down executors
- Add early-access check
- Adapter action future should restore interrupts
- Disable bootstrap checks for single-node discovery
- Enable explicitly enforcing bootstrap checks
- Add equals/hashcode method to ReplicationResponse

Dates::
- Improve error handling for epoch format parser with time zone
  (#22621)

Discovery::
- Introduce single-node discovery
- UnicastZenPing shouldn't ping the address of the local node
- MasterFaultDetection can start after the initial cluster state has
  been processed

Highlighting::
- Add support for fragment_length in the unified highlighter
- Add BreakIteratorBoundaryScanner support

Index APIs::
- Wildcard cluster names for cross cluster search

Ingest::
- Lazy load the geoip databases

Internal::
- Add a dedicated TransportRemoteInfoAction for consistency
- Simplify sorted top docs merging in SearchPhaseController
- Synchronized CollapseTopFieldDocs with lucenes relatives
- Cleanup SearchPhaseController interface
- Do not create String instances in 'Strings' methods accepting
  StringBuilder

Java API::
- Added types options to DeleteByQueryRequest

Java High Level REST Client::
- Convert suggestion response parsing to use NamedXContentRegistry
- UpdateRequest implements ToXContent
- Add javadoc for DocWriteResponse.Builders
- Expose WriteRequest.RefreshPolicy string representation
- Use `typed_keys` parameter to prefix suggester names by type in
  search responses
- Add parsing methods to BulkItemResponse

Logging::
- Warn on not enough masters during election

Mapping::
- Improve error message for ipv6 on legacy ip fields

Nested Docs::
- Avoid adding unnecessary nested filters when ranges are used.

Network::
- Adjust default Netty receive predictor size to 64k
- Keep the pipeline handler queue small initially
- Set network receive predictor size to 32kb
- TransportService.connectToNode should validate remote node ID

Packaging::
- Introduce Java version check
- Cleanup some things after removal of joda-time hack

Percolator::
- Allowing range queries with now ranges inside percolator queries
- Add term extraction support for MultiPhraseQuery

Plugin Discovery EC2::
- Settings: Migrate ec2 discovery sensitive settings to elasticsearch
  keystore

Plugin Lang Painless::
- Allow painless to load stored fields
- Start on custom whitelists for Painless
- Fix Painless's implementation of interfaces returning primitives
- Allow painless to implement more interfaces

Plugin Repository Azure::
- Add Backoff policy to azure repository

Plugin Repository S3::
- Removes the retry mechanism from the S3 blob store
- S3 Repository: Eagerly load static settings

Plugins::
- Modify permissions dialog for plugins
- Plugins: Add plugin cli specific exit codes
- Plugins: Output better error message when existing plugin is
  incompatible

Query DSL::
- Make it possible to validate a query on all shards instead of a
  single random shard

REST::
- Validate top-level keys when parsing mget requests
- Cluster stats should not render empty http/transport types
- Add parameter to prefix aggs name with type in search responses

Search::
- Set shard count limit to unlimited
- Streamline shard index availability in all SearchPhaseResults
- Search took time should use a relative clock
- Prevent negative `from` parameter in SearchSourceBuilder
- Remove unnecessary result sorting in SearchPhaseController
- Expose `batched_reduce_size` via `_search`
- Adding fromXContent to Suggest and Suggestion class
- Adding fromXContent to Suggestion.Entry and subclasses
- Add CollapseSearchPhase as a successor for the FetchSearchPhase
- Integrate IndexOrDocValuesQuery.
- Detach SearchPhases from AbstractSearchAsyncAction
- Fix GraphQuery expectation after Lucene upgrade to 6.5
- Nested queries should avoid adding unnecessary filters when
  possible.
- Add xcontent parsing to completion suggestion option
- Add xcontent parsing to suggestion options
- Separate reduce (aggs, suggest and profile) from merging fetched
  hits

Settings::
- Add secure file setting to keystore
- Add a setting which specifies a list of setting
- Add a property to mark setting as final
- Remove obsolete index setting `index.version.minimum_compatible`.
- Provide a method to retrieve a closeable char[] from a SecureString
- Update indices settings api to support CBOR and SMILE format
- Improve setting deprecation message

Snapshot/Restore::
- Change snapshot status error to use generic SnapshotException

Stats::
- Add cross-cluster search remote cluster info API

Task Manager::
- Allow task to be unregistered by ClusterStateApplier
- Limit IndexRequest toString() length


=== Bug fixes

Aggregations::
- Align behavior HDR percentiles iterator with percentile() method
- The `filter` and `significant_terms` aggregations should parse the
  `filter` as a filter, not a query.
- Completion suggestion should also consider text if prefix/regex is
  missing
- Fixes the per term error in the terms aggregation
- Fixes terms error count for multiple reduce phases
- Restore support for the `include/pattern` syntax.

Bulk::
- Reject empty IDs

CRUD::
- Fix backport executing ops as single item bulk

Cluster::
- Don't set local node on cluster state used for node join validation
- Allow a cluster state applier to create an observer and wait for a
  better state
- Cluster allocation explain to never return empty response body

Core::
- Check for default.path.data included in path.data
- Improve performance of extracting warning value
- Reject duplicate settings on the command line
- Restrict build info loading to ES jar, not any jar

Discovery::
- ZenDiscovery - only validate min_master_nodes values if local node
  is master

Index APIs::
- Fixes restore of a shrunken index when initial recovery node is gone
- Honor update request timeout

Ingest::
- Improve missing ingest processor error
- update _ingest.timestamp to use new ZonedDateTime

Inner Hits::
- Replace NestedChildrenQuery with ParentChildrenBlockJoinQuery
- Changed DisMaxQueryBuilder to extract inner hits from leaf queries

Internal::
- Add infrastructure to mark contexts as system contexts
- Always restore the ThreadContext for operations delayed due to a
  block

Java High Level REST Client::
- Correctly parse BulkItemResponse.Failure's status

Java REST Client::
- Make buffer limit configurable in HeapBufferedConsumerFactory
- RestClient asynchronous execution should not throw exceptions

Mapping::
- Preserve response headers when creating an index
- Improves disabled fielddata error message
- Switch include_in_all in multifield to warning
- Fix MapperService StackOverflowError
- Fix NPE with scaled floats stats when field is not indexed

Network::
- Fix possible hang in local transport when nodes get concurrently
  disconnected
- Respect promises on pipelined responses
- Ensure that releasing listener is called

Packaging::
- Fall back to non-atomic move when removing plugins

Percolator::
- Fix memory leak when percolator uses bitset or field data cache

Plugin Ingest Attachment::
- Remove support for Visio and potm files

Plugin Lang Painless::
- Fix painless's regex lexer and error messages
- Replace Painless's Cast with casting strategies
- Fix Bad Casts In Painless

Plugin Repository Azure::
- Azure blob store's readBlob() method first checks if the blob exists

Plugin Repository S3::
- Handle BlobPath's trailing separator case. Add test cases to
  BlobPathTests.java

Plugins::
- Fix delete of plugin directory on remove plugin
- Use a marker file when removing a plugin

Query DSL::
- FuzzyQueryBuilder should error when parsing array of values

REST::
- [API] change wait_for_completion default according to docs
- Deprecate request_cache for clear-cache
- HTTP transport stashes the ThreadContext instead of the
  RestController
- Ensure we try to autodetect content type for handlers that support
  plain text
- Fix date format in warning headers
- Align REST specs for HEAD requests
- Correct warning header to be compliant
- Fix get HEAD requests
- Fix search scroll request with a plain text body
- Handle bad HTTP requests
- Fix get source HEAD requests
- Properly encode location header
- Fix template HEAD requests
- Fix index HEAD requests
- Fix alias HEAD requests

Recovery::
- Provide target allocation id as part of start recovery request

Reindex API::
- Fix throttled reindex_from_remote
- Fix reindex with a remote source on a version before 2.0.0
- Make reindex wait for cleanup before responding

Scripting::
- Remove unnecessary Groovy deprecation logging
- Convert script/template objects to json format internally
- Script: Fix value of `ctx._now` to be current epoch time in
  milliseconds

Search::
- Cross Cluster Search: propagate original indices per cluster
- Query string default field
- Speed up parsing of large `terms` queries.
- IndicesQueryCache should delegate the scorerSupplier method.
- Fork LRUQueryCache from Lucene to work around LUCENE-7749
- Disable graph analysis at query time for shingle and cjk filters
  producing tokens of different size
- Fix cross-cluster remote node gateway attributes
- Use a fixed seed for computing term hashCode in TermsSliceQuery
- Honor max concurrent searches in multi-search
- Avoid stack overflow in multi-search
- Fix query_string_query to transform "foo:*" in an exists query on
  the field name
- Factor out filling of TopDocs in SearchPhaseController
- Replace blocking calls in ExpandCollapseSearchResponseListener by
  asynchronous requests

Search Templates::
- No longer add illegal content type option to stored search templates

Settings::
- Do not set path.data in environment if not set
- Correct handling of default and array settings
- Fix merge scheduler config settings
- Settings: Fix keystore cli prompting for yes/no to handle console
  returning null

Similarities::
- Fix similarity upgrade when "default" similarity is overridden

Snapshot/Restore::
- Fixes maintaining the shards a snapshot is waiting on
- Fixes snapshot status on failed snapshots
- Fixes snapshot deletion handling on in-progress snapshot failure
- Prioritize listing index-N blobs over index.latest in reading
  snapshots

Stats::
- Avoid overflow when computing total FS stats
- Handle existence of cgroup version 2 hierarchy
- Handle long overflow when adding paths' totals
- Fix control group pattern
- Fix total disk bytes returning negative value


=== Regressions

Bulk::
- Fix _bulk response when it can't create an index


=== Upgrades

Aggregations::
- Upgrade HDRHistogram to 2.1.9

Core::
- Upgrade to Lucene 6.5.0
- Upgrade from JNA 4.2.2 to JNA 4.4.0
- Upgrade to lucene-6.5.0-snapshot-d00c5ca
- Upgrade to lucene-6.5.0-snapshot-f919485.

Logging::
- Upgrade to Log4j 2.8.2

Network::
- Upgrade to Netty 4.1.9
- Upgrade to Netty 4.1.8

Plugin Repository Azure::
- Update to Azure Storage 5.0.0

diffstat:

 databases/elasticsearch/Makefile |   4 +-
 databases/elasticsearch/PLIST    |  58 ++++++++++++++++++++--------------------
 databases/elasticsearch/distinfo |  10 +++---
 3 files changed, 36 insertions(+), 36 deletions(-)

diffs (122 lines):

diff -r b43b73f91c68 -r 9cefbb2d436d databases/elasticsearch/Makefile
--- a/databases/elasticsearch/Makefile  Thu May 11 08:23:57 2017 +0000
+++ b/databases/elasticsearch/Makefile  Thu May 11 08:36:30 2017 +0000
@@ -1,6 +1,6 @@
-# $NetBSD: Makefile,v 1.27 2017/04/22 17:20:54 fhajny Exp $
+# $NetBSD: Makefile,v 1.28 2017/05/11 08:36:30 fhajny Exp $
 
-DISTNAME=      elasticsearch-5.3.1
+DISTNAME=      elasticsearch-5.4.0
 CATEGORIES=    textproc
 MASTER_SITES=  https://artifacts.elastic.co/downloads/elasticsearch/
 
diff -r b43b73f91c68 -r 9cefbb2d436d databases/elasticsearch/PLIST
--- a/databases/elasticsearch/PLIST     Thu May 11 08:23:57 2017 +0000
+++ b/databases/elasticsearch/PLIST     Thu May 11 08:36:30 2017 +0000
@@ -1,8 +1,8 @@
-@comment $NetBSD: PLIST,v 1.18 2017/04/22 17:20:54 fhajny Exp $
+@comment $NetBSD: PLIST,v 1.19 2017/05/11 08:36:30 fhajny Exp $
 bin/elasticsearch
 bin/elasticsearch-plugin
 lib/elasticsearch/bin/elasticsearch.in.sh
-lib/elasticsearch/lib/HdrHistogram-2.1.6.jar
+lib/elasticsearch/lib/HdrHistogram-2.1.9.jar
 lib/elasticsearch/lib/${PKGNAME}.jar
 lib/elasticsearch/lib/hppc-0.7.1.jar
 lib/elasticsearch/lib/jackson-core-2.8.6.jar
@@ -10,28 +10,28 @@
 lib/elasticsearch/lib/jackson-dataformat-smile-2.8.6.jar
 lib/elasticsearch/lib/jackson-dataformat-yaml-2.8.6.jar
 lib/elasticsearch/lib/java-version-checker-${PKGVERSION}.jar
-lib/elasticsearch/lib/jna-4.2.2.jar
+lib/elasticsearch/lib/jna-4.4.0.jar
 lib/elasticsearch/lib/joda-time-2.9.5.jar
 lib/elasticsearch/lib/jopt-simple-5.0.2.jar
 lib/elasticsearch/lib/jts-1.13.jar
-lib/elasticsearch/lib/log4j-1.2-api-2.7.jar
-lib/elasticsearch/lib/log4j-api-2.7.jar
-lib/elasticsearch/lib/log4j-core-2.7.jar
-lib/elasticsearch/lib/lucene-analyzers-common-6.4.2.jar
-lib/elasticsearch/lib/lucene-backward-codecs-6.4.2.jar
-lib/elasticsearch/lib/lucene-core-6.4.2.jar
-lib/elasticsearch/lib/lucene-grouping-6.4.2.jar
-lib/elasticsearch/lib/lucene-highlighter-6.4.2.jar
-lib/elasticsearch/lib/lucene-join-6.4.2.jar
-lib/elasticsearch/lib/lucene-memory-6.4.2.jar
-lib/elasticsearch/lib/lucene-misc-6.4.2.jar
-lib/elasticsearch/lib/lucene-queries-6.4.2.jar
-lib/elasticsearch/lib/lucene-queryparser-6.4.2.jar
-lib/elasticsearch/lib/lucene-sandbox-6.4.2.jar
-lib/elasticsearch/lib/lucene-spatial-6.4.2.jar
-lib/elasticsearch/lib/lucene-spatial-extras-6.4.2.jar
-lib/elasticsearch/lib/lucene-spatial3d-6.4.2.jar
-lib/elasticsearch/lib/lucene-suggest-6.4.2.jar
+lib/elasticsearch/lib/log4j-1.2-api-2.8.2.jar
+lib/elasticsearch/lib/log4j-api-2.8.2.jar
+lib/elasticsearch/lib/log4j-core-2.8.2.jar
+lib/elasticsearch/lib/lucene-analyzers-common-6.5.0.jar
+lib/elasticsearch/lib/lucene-backward-codecs-6.5.0.jar
+lib/elasticsearch/lib/lucene-core-6.5.0.jar
+lib/elasticsearch/lib/lucene-grouping-6.5.0.jar
+lib/elasticsearch/lib/lucene-highlighter-6.5.0.jar
+lib/elasticsearch/lib/lucene-join-6.5.0.jar
+lib/elasticsearch/lib/lucene-memory-6.5.0.jar
+lib/elasticsearch/lib/lucene-misc-6.5.0.jar
+lib/elasticsearch/lib/lucene-queries-6.5.0.jar
+lib/elasticsearch/lib/lucene-queryparser-6.5.0.jar
+lib/elasticsearch/lib/lucene-sandbox-6.5.0.jar
+lib/elasticsearch/lib/lucene-spatial-6.5.0.jar
+lib/elasticsearch/lib/lucene-spatial-extras-6.5.0.jar
+lib/elasticsearch/lib/lucene-spatial3d-6.5.0.jar
+lib/elasticsearch/lib/lucene-suggest-6.5.0.jar
 lib/elasticsearch/lib/securesm-1.1.jar
 lib/elasticsearch/lib/snakeyaml-1.15.jar
 lib/elasticsearch/lib/spatial4j-0.6.jar
@@ -47,7 +47,7 @@
 lib/elasticsearch/modules/lang-expression/asm-commons-5.0.4.jar
 lib/elasticsearch/modules/lang-expression/asm-tree-5.0.4.jar
 lib/elasticsearch/modules/lang-expression/lang-expression-${PKGVERSION}.jar
-lib/elasticsearch/modules/lang-expression/lucene-expressions-6.4.2.jar
+lib/elasticsearch/modules/lang-expression/lucene-expressions-6.5.0.jar
 lib/elasticsearch/modules/lang-expression/plugin-descriptor.properties
 lib/elasticsearch/modules/lang-expression/plugin-security.policy
 lib/elasticsearch/modules/lang-groovy/groovy-2.4.6-indy.jar
@@ -78,13 +78,13 @@
 lib/elasticsearch/modules/transport-netty3/plugin-descriptor.properties
 lib/elasticsearch/modules/transport-netty3/plugin-security.policy
 lib/elasticsearch/modules/transport-netty3/transport-netty3-${PKGVERSION}.jar
-lib/elasticsearch/modules/transport-netty4/netty-buffer-4.1.7.Final.jar
-lib/elasticsearch/modules/transport-netty4/netty-codec-4.1.7.Final.jar
-lib/elasticsearch/modules/transport-netty4/netty-codec-http-4.1.7.Final.jar
-lib/elasticsearch/modules/transport-netty4/netty-common-4.1.7.Final.jar
-lib/elasticsearch/modules/transport-netty4/netty-handler-4.1.7.Final.jar
-lib/elasticsearch/modules/transport-netty4/netty-resolver-4.1.7.Final.jar
-lib/elasticsearch/modules/transport-netty4/netty-transport-4.1.7.Final.jar
+lib/elasticsearch/modules/transport-netty4/netty-buffer-4.1.9.Final.jar
+lib/elasticsearch/modules/transport-netty4/netty-codec-4.1.9.Final.jar
+lib/elasticsearch/modules/transport-netty4/netty-codec-http-4.1.9.Final.jar
+lib/elasticsearch/modules/transport-netty4/netty-common-4.1.9.Final.jar
+lib/elasticsearch/modules/transport-netty4/netty-handler-4.1.9.Final.jar
+lib/elasticsearch/modules/transport-netty4/netty-resolver-4.1.9.Final.jar
+lib/elasticsearch/modules/transport-netty4/netty-transport-4.1.9.Final.jar
 lib/elasticsearch/modules/transport-netty4/plugin-descriptor.properties
 lib/elasticsearch/modules/transport-netty4/plugin-security.policy
 lib/elasticsearch/modules/transport-netty4/transport-netty4-${PKGVERSION}.jar
diff -r b43b73f91c68 -r 9cefbb2d436d databases/elasticsearch/distinfo
--- a/databases/elasticsearch/distinfo  Thu May 11 08:23:57 2017 +0000
+++ b/databases/elasticsearch/distinfo  Thu May 11 08:36:30 2017 +0000
@@ -1,9 +1,9 @@
-$NetBSD: distinfo,v 1.28 2017/04/22 17:20:54 fhajny Exp $
+$NetBSD: distinfo,v 1.29 2017/05/11 08:36:30 fhajny Exp $
 
-SHA1 (elasticsearch-5.3.1.tar.gz) = 26100fb2b2c824530f29a7cc6148e2315e1a1fe3
-RMD160 (elasticsearch-5.3.1.tar.gz) = 27b75e3701aa2af847f959754844a4530245c77a
-SHA512 (elasticsearch-5.3.1.tar.gz) = 048323cd7278a521dde8e618e1b24850cebbe7e88cd46f7aae6ffa5a705031bac871ca62cf817d5493d15de204f82a2db0cf2c36b1a45f4259db5ee8c928bdf4
-Size (elasticsearch-5.3.1.tar.gz) = 33702280 bytes
+SHA1 (elasticsearch-5.4.0.tar.gz) = 880b115be755a923f25aea810e3386ccb723cc55
+RMD160 (elasticsearch-5.4.0.tar.gz) = 0c8a81e9a458c171fa65075bb8f73f62d7a039f9
+SHA512 (elasticsearch-5.4.0.tar.gz) = 52718b73ebf9de491d1815adce62e7ef61d257a074495b7f81d9ff3a81e5a4c25600f02a2de01edda4d8fa798d81602a75375b6774dced714b1c14edce46739b
+Size (elasticsearch-5.4.0.tar.gz) = 33302352 bytes
 SHA1 (patch-bin_elasticsearch) = 5360818fb870c0005e23f0fb247efa247a909f47
 SHA1 (patch-bin_elasticsearch-plugin) = 56db071765b91a4846e1529b5fe8be2c549b449d
 SHA1 (patch-config_elasticsearch.yml) = 8a59f9123b8bc1c40d17131dc51c361fa210c17c



Home | Main Index | Thread Index | Old Index