pkgsrc-Changes-HG archive

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]

[pkgsrc/trunk]: pkgsrc/databases/elasticsearch elasticsearch 5.5.2



details:   https://anonhg.NetBSD.org/pkgsrc/rev/c428c6a7658e
branches:  trunk
changeset: 366815:c428c6a7658e
user:      fhajny <fhajny%pkgsrc.org@localhost>
date:      Fri Aug 18 09:03:08 2017 +0000

description:
elasticsearch 5.5.2
======================================================================

=== Bug fixes

Aggregations::
- Fixes array out of bounds for value count agg

Core::
- Release operation permit on thread-pool rejection

Inner Hits::
- Fix inner hits to work with queries wrapped in an indices query
- When fetching nested inner hits only access stored fields when needed

Logging::
- Declare XContent deprecation logger as static

Query DSL::
- Parse "*" in query_string_query as MatchAllDocsQuery



elasticsearch 5.5.1
======================================================================

=== Bug fixes

Aliases::
- mget with an alias shouldn't ignore alias routing

Engine::
- Engine - Do not store operations that are not index into lucene in the
  translog (5.x only)

Internal::
- Fix BytesReferenceStreamInput#skip with offset

Packaging::
- Stop disabling explicit GC
- Avoid failing install if system-sysctl is masked
- Get short path name for native controllers

Query DSL::
- WrapperQueryBuilder should also rewrite the parsed query



elasticsearch 5.5.0
======================================================================

=== Breaking changes

Plugins::
- Remove hidden file leniency from spawner

Settings::
- Remove support for default settings

=== Breaking Java changes

Aggregations::
- Remove the unused SignificantTerms.compareTerm() method
- Make SignificantTerms.Bucket an interface rather than an abstract
  class
- Make Terms.Bucket an interface rather than an abstract class

Plugin Delete By Query::
- Move DeleteByQuery and Reindex requests into core


=== Deprecations

Index APIs::
- Deprecated use of + in index expressions

Packaging::
- Add deprecation warnings for $ES_USER and $ES_GROUP

Plugin Repository S3::
- S3 Repository: Deprecate remaining `repositories.s3.*` settings

REST::
- Add deprecation logging for comma-separated feature parsing

Scripting::
- Scripting: Deprecate native scripts
- Scripting: Deprecate index lookup
- Deprecate Fine Grain Settings for Scripts
- Scripting: Deprecate file script settings
- Scripting: Deprecate file scripts

Settings::
- Settings: Update settings deprecation from yml to yaml
- Deprecate settings in .yml and .json

Tribe Node::
- Deprecate tribe service


=== New features

Mapping::
- Add new ip_range field type

Plugin Analysis ICU::
- Add ICUCollationFieldMapper


=== Enhancements

Aggregations::
- Add superset size to Significant Term REST response
- Add document count to Matrix Stats aggregation response
-  Share XContent rendering code in significant terms aggregations
- Add `count` to rest output of `geo_centroid`
- Allow scripted metric agg to access `_score`

Aliases::
- Handle multiple aliases in _cat/aliases api

Circuit Breakers::
- Closing a ReleasableBytesStreamOutput closes the underlying BigArray

Cluster::
- Add a cluster block that allows to delete indices that are read-only
- Extract a common base class to allow services to listen to remote
  cluster config updates

Core::
- Explicitly reject duplicate data paths
- Use SPI in High Level Rest Client to load XContent parsers
- Improve bootstrap checks error messages
- Regex upgrades
- Detect remnants of path.data/default.path.data bug

Engine::
- Add refresh stats tracking for realtime get
- Engine: store maxUnsafeAutoIdTimestamp in commit

Exceptions::
- IllegalStateException: Only duplicated jar instead of classpath

Index APIs::
- Open and close index to honour allow_no_indices option

Ingest::
- add `exclude_keys` option to KeyValueProcessor

Inner Hits::
- Reuse inner hit query weight

Internal::
- "shard started" should show index and shard ID
- Add the ability to set eager_global_ordinals in the new parent-join
  field
- Add assertions enabled helper
- Add cross cluster support to `_field_caps`
- Log JVM arguments on startup
- Preserve cluster alias throughout search execution to lookup nodes by
  cluster and ID
- Move RemoteClusterService into TransportService
- Enum related performance additions.

Java API::
- Always Accumulate Transport Exceptions

Java High Level REST Client::
- Add doc_count to ParsedMatrixStats
- Add fromXContent method to ClearScrollResponse
- ClearScrollRequest to implement ToXContentObject
- SearchScrollRequest to implement ToXContentObject
- Backport aggs parsers for high level REST Client
- Add utility method to parse named XContent objects with typed prefix

Logging::
- Warn on not enough masters during election

Mapping::
- Do not index `_type` when there is at most one type.
- Only allow one type on 6.0 indices
- token_count type : add an option to count tokens (fix #23227)

Network::
- Disable the Netty recycler in the client
- Remove Netty logging hack
- Set available processors for Netty

Packaging::
- Set number of processes in systemd unit file

Plugin Lang Painless::
- Optimize instance creation in LambdaBootstrap
- Allow painless to load stored fields

Plugin Repository GCS::
- GCS Repository: Add secure storage of credentials

Plugins::
- Add purge option to remove plugin CLI
- Move ReindexAction class to core
- Plugins: Add support for platform specific plugins

REST::
- Make ObjectParser support string to boolean conversion
- Allow passing single scrollID in clear scroll API body

Scripting::
- Add Ability to Specify No Types/Contexts Allowed For Scripts
- Add New Security Script Settings

Search::
- Eliminate array access in tight loops when profiling is enabled.
- Support Multiple Inner Hits on a Field Collapse Request
- Expand cross cluster search indices for search requests to the
  concrete index or to it's aliases
- Remove leniency when merging fetched hits in a search response phase

Search Templates::
- Add max concurrent searches to multi template search

Settings::
- Emit settings deprecation logging at most once

Snapshot/Restore::
- Improves snapshot logging and snapshot deletion error handling
- Enhances get snapshots API to allow retrieving repository index only
- Ensure every repository has an incompatible-snapshots blob
- Change snapshot status error to use generic SnapshotException

Stats::
- Show JVM arguments

Suggesters::
- Provide informative error message in case of unknown suggestion
  context.
- Allow different data types for category in Context suggester

Upgrade API::
- Allow plugins to upgrade templates and index metadata on startup


=== Bug fixes

Aggregations::
- Terms aggregation should remap global ordinal buckets when a
  sub-aggregator is used to sort the terms
- Correctly set doc_count when MovAvg "predicts" values on existing
  buckets
- InternalPercentilesBucket should not rely on ordered percents array
- Align behavior HDR percentiles iterator with percentile() method
- DateHistogram: Fix `extended_bounds` with `offset`
- Fix ArrayIndexOutOfBoundsException when no ranges are specified in the
  query

Aliases::
- GET aliases should 404 if aliases are missing

Allocation::
- Discard stale node responses from async shard fetching

Analysis::
- PatternAnalyzer should lowercase wildcard queries when `lowercase` is
  true.

Bulk::
- Reject empty IDs

Cache::
- fix bug of weight computation

Circuit Breakers::
- Checks the circuit breaker before allocating bytes for a new big array

Core::
- Fix cache expire after access
- Check for default.path.data included in path.data

Geo::
- Fix GeoPoint FieldStats ternary logic bug
- Fix GeoDistance Ordinal for BWC

Highlighting::
- Higlighters: Fix MultiPhrasePrefixQuery rewriting

Index APIs::
- Rollover max docs should only count primaries
- Fix legacy GeoPointField decoding in FieldStats
- Validates updated settings on closed indices
- Fixes restore of a shrunken index when initial recovery node is gone

Ingest::
- fix grok's pattern parsing to validate pattern names in expression
- Fix floating-point error when DateProcessor parses UNIX
- add option for _ingest.timestamp to use new ZonedDateTime (5.x
  backport)

Inner Hits::
- Fix Source filtering in new field collapsing feature

Internal::
- Fix race condition in RemoteClusterConnection node supplier
- Initialise empty lists in BaseTaskResponse constructor
- Extract a common base class for scroll executions
- Ensure remote cluster is connected before fetching `_field_caps`
- Obey lock order if working with store to get metadata snapshots
- Remove `_UNRELEASED` from Version constants for released versions
- Fix `_field_caps` serialization in order to support cross cluster
  search
- Avoid race when shutting down controller processes
- Fix NPE if field caps request has a field that exists not in all
  indices

More Like This::
- Pass over _routing value with more_like_this items to be retrieved

Nested Docs::
- In case of a single type the _id field should be added to the nested
  document instead of _uid field

Network::
- Ensure pending transport handlers are invoked for all channel failures
- Notify onConnectionClosed rather than onNodeDisconnect to prune
  transport handlers
- SniffNodesSampler should close connection after handling responses

Packaging::
- When stopping via systemd only kill the JVM, not its control group
- Handle parentheses in batch file path

Percolator::
- Fix range queries with date range based on current time in percolator
  queries.
- For legacy indices rewrite percolator query upon percolation time
- Fix memory leak when percolator uses bitset or field data cache

Plugin Lang Painless::
- painless: Fix method references to ctor with the new LambdaBootstrap
  and cleanup code
- Fix Painless Lambdas for Java 9

Plugins::
- X-Pack plugin download fails on Windows desktop
- Fix plugin installation permissions
- Fix delete of plugin directory on remove plugin
- Use a marker file when removing a plugin
- Remove hidden file leniency from plugin service

Query DSL::
- Thread falls into infinite loop when processing Indices query

REST::
- Fix handling of exceptions thrown on HEAD requests
- Fixed NPEs caused by requests without content.
- Fix get mappings HEAD requests

Recovery::
- Provide target allocation id as part of start recovery request

Reindex API::
- Reindex: don't duplicate _source parameter
- Add qa module that tests reindex-from-remote against pre-5.0 versions
  of Elasticsearch

Scroll::
- Fix single shard scroll within a cluster with nodes in version `>=
  5.3` and `<= 5.3`

Search::
- Adds check for negative search request size
- Do not search locally if remote index pattern resolves to no indices
- Make sure range queries are correctly profiled.
- Compute the took time of the query after the expand phase of field
  collapsing
- Fix RangeFieldMapper rangeQuery to properly handle relations
- Fix ExpandSearchPhase when response contains no hits
- Include all aliases including non-filtering in  `_search_shards`
  response
- Cross Cluster Search: propagate original indices per cluster

Search Templates::
- No longer add illegal content type option to stored search templates

Settings::
- Keystore CLI should use the AddFileKeyStoreCommand for files
- Settings: Fix setting groups to include secure settings
- Allow resetting settings that use an IP validator
- Do not set path.data in environment if not set

Snapshot/Restore::
- Output all empty snapshot info fields if in verbose mode
- Remove redundant and broken MD5 checksum from repository-s3
- Consolidates the logic for cleaning up snapshots on master election
- Removes completed snapshot from cluster state on master change
- Fix inefficient (worst case exponential) loading of snapshot
  repository
- Fixes maintaining the shards a snapshot is waiting on

Stats::
- _nodes/stats should not fail due to concurrent AlreadyClosedException
- Avoid double decrement on current query counter

Suggesters::
- Fix context suggester to read values from keyword type field

Task Manager::
- Task Management: Make TaskInfo parsing forwards compatible


=== Regressions

Highlighting::
- Fix Fast Vector Highlighter NPE on match phrase prefix


=== Upgrades

Core::
- Upgrade to Lucene 6.5.1

Network::
- Upgrade to Netty 4.1.11.Final
- Upgrade Netty to 4.1.10.Final

diffstat:

 databases/elasticsearch/Makefile |   4 ++--
 databases/elasticsearch/PLIST    |  37 ++++++++++++++++++++-----------------
 databases/elasticsearch/distinfo |  10 +++++-----
 3 files changed, 27 insertions(+), 24 deletions(-)

diffs (95 lines):

diff -r f538f6c95c22 -r c428c6a7658e databases/elasticsearch/Makefile
--- a/databases/elasticsearch/Makefile  Fri Aug 18 01:15:02 2017 +0000
+++ b/databases/elasticsearch/Makefile  Fri Aug 18 09:03:08 2017 +0000
@@ -1,6 +1,6 @@
-# $NetBSD: Makefile,v 1.31 2017/07/04 14:19:48 fhajny Exp $
+# $NetBSD: Makefile,v 1.32 2017/08/18 09:03:08 fhajny Exp $
 
-DISTNAME=      elasticsearch-5.4.3
+DISTNAME=      elasticsearch-5.5.2
 CATEGORIES=    textproc
 MASTER_SITES=  https://artifacts.elastic.co/downloads/elasticsearch/
 
diff -r f538f6c95c22 -r c428c6a7658e databases/elasticsearch/PLIST
--- a/databases/elasticsearch/PLIST     Fri Aug 18 01:15:02 2017 +0000
+++ b/databases/elasticsearch/PLIST     Fri Aug 18 09:03:08 2017 +0000
@@ -1,4 +1,4 @@
-@comment $NetBSD: PLIST,v 1.20 2017/06/14 13:49:35 fhajny Exp $
+@comment $NetBSD: PLIST,v 1.21 2017/08/18 09:03:08 fhajny Exp $
 bin/elasticsearch
 bin/elasticsearch-plugin
 lib/elasticsearch/bin/elasticsearch.in.sh
@@ -17,21 +17,22 @@
 lib/elasticsearch/lib/log4j-1.2-api-2.8.2.jar
 lib/elasticsearch/lib/log4j-api-2.8.2.jar
 lib/elasticsearch/lib/log4j-core-2.8.2.jar
-lib/elasticsearch/lib/lucene-analyzers-common-6.5.1.jar
-lib/elasticsearch/lib/lucene-backward-codecs-6.5.1.jar
-lib/elasticsearch/lib/lucene-core-6.5.1.jar
-lib/elasticsearch/lib/lucene-grouping-6.5.1.jar
-lib/elasticsearch/lib/lucene-highlighter-6.5.1.jar
-lib/elasticsearch/lib/lucene-join-6.5.1.jar
-lib/elasticsearch/lib/lucene-memory-6.5.1.jar
-lib/elasticsearch/lib/lucene-misc-6.5.1.jar
-lib/elasticsearch/lib/lucene-queries-6.5.1.jar
-lib/elasticsearch/lib/lucene-queryparser-6.5.1.jar
-lib/elasticsearch/lib/lucene-sandbox-6.5.1.jar
-lib/elasticsearch/lib/lucene-spatial-6.5.1.jar
-lib/elasticsearch/lib/lucene-spatial-extras-6.5.1.jar
-lib/elasticsearch/lib/lucene-spatial3d-6.5.1.jar
-lib/elasticsearch/lib/lucene-suggest-6.5.1.jar
+lib/elasticsearch/lib/lucene-analyzers-common-6.6.0.jar
+lib/elasticsearch/lib/lucene-backward-codecs-6.6.0.jar
+lib/elasticsearch/lib/lucene-core-6.6.0.jar
+lib/elasticsearch/lib/lucene-grouping-6.6.0.jar
+lib/elasticsearch/lib/lucene-highlighter-6.6.0.jar
+lib/elasticsearch/lib/lucene-join-6.6.0.jar
+lib/elasticsearch/lib/lucene-memory-6.6.0.jar
+lib/elasticsearch/lib/lucene-misc-6.6.0.jar
+lib/elasticsearch/lib/lucene-queries-6.6.0.jar
+lib/elasticsearch/lib/lucene-queryparser-6.6.0.jar
+lib/elasticsearch/lib/lucene-sandbox-6.6.0.jar
+lib/elasticsearch/lib/lucene-spatial-6.6.0.jar
+lib/elasticsearch/lib/lucene-spatial-extras-6.6.0.jar
+lib/elasticsearch/lib/lucene-spatial3d-6.6.0.jar
+lib/elasticsearch/lib/lucene-suggest-6.6.0.jar
+lib/elasticsearch/lib/plugin-cli-${PKGVERSION}.jar
 lib/elasticsearch/lib/securesm-1.1.jar
 lib/elasticsearch/lib/snakeyaml-1.15.jar
 lib/elasticsearch/lib/spatial4j-0.6.jar
@@ -47,7 +48,7 @@
 lib/elasticsearch/modules/lang-expression/asm-commons-5.0.4.jar
 lib/elasticsearch/modules/lang-expression/asm-tree-5.0.4.jar
 lib/elasticsearch/modules/lang-expression/lang-expression-${PKGVERSION}.jar
-lib/elasticsearch/modules/lang-expression/lucene-expressions-6.5.1.jar
+lib/elasticsearch/modules/lang-expression/lucene-expressions-6.6.0.jar
 lib/elasticsearch/modules/lang-expression/plugin-descriptor.properties
 lib/elasticsearch/modules/lang-expression/plugin-security.policy
 lib/elasticsearch/modules/lang-groovy/groovy-2.4.6-indy.jar
@@ -63,6 +64,8 @@
 lib/elasticsearch/modules/lang-painless/lang-painless-${PKGVERSION}.jar
 lib/elasticsearch/modules/lang-painless/plugin-descriptor.properties
 lib/elasticsearch/modules/lang-painless/plugin-security.policy
+lib/elasticsearch/modules/parent-join/parent-join-${PKGVERSION}.jar
+lib/elasticsearch/modules/parent-join/plugin-descriptor.properties
 lib/elasticsearch/modules/percolator/percolator-${PKGVERSION}.jar
 lib/elasticsearch/modules/percolator/plugin-descriptor.properties
 lib/elasticsearch/modules/reindex/commons-codec-1.10.jar
diff -r f538f6c95c22 -r c428c6a7658e databases/elasticsearch/distinfo
--- a/databases/elasticsearch/distinfo  Fri Aug 18 01:15:02 2017 +0000
+++ b/databases/elasticsearch/distinfo  Fri Aug 18 09:03:08 2017 +0000
@@ -1,9 +1,9 @@
-$NetBSD: distinfo,v 1.32 2017/07/04 14:19:48 fhajny Exp $
+$NetBSD: distinfo,v 1.33 2017/08/18 09:03:08 fhajny Exp $
 
-SHA1 (elasticsearch-5.4.3.tar.gz) = 2f097fa85b3fde9b3b02df7d345289c500075aa2
-RMD160 (elasticsearch-5.4.3.tar.gz) = c1de8a82cba88950d90baaea80960ac37b07e178
-SHA512 (elasticsearch-5.4.3.tar.gz) = 8cc8c96ed6d1db947f20624b5231a9718897fbe5acdab9828ef3ec580b8e5bef2bbdf961ace437d192c2bae3d70f6962e1ab6985c25e314979daf6479470acc0
-Size (elasticsearch-5.4.3.tar.gz) = 33326964 bytes
+SHA1 (elasticsearch-5.5.2.tar.gz) = 91b3b3c823fafce54609ed5c9075d9cf50b2edff
+RMD160 (elasticsearch-5.5.2.tar.gz) = d4c369766b8480316f10bd2f1f541250446132f1
+SHA512 (elasticsearch-5.5.2.tar.gz) = 62048f15b43e38a61e3a19a1599c25cd0d9009cc1172db5b450b04dec349ecd313b1f20e3d1c7ed1c101ae3e6f6c6d2cdf004a9713ad803576277f93e3adbdb9
+Size (elasticsearch-5.5.2.tar.gz) = 33485703 bytes
 SHA1 (patch-bin_elasticsearch) = 5360818fb870c0005e23f0fb247efa247a909f47
 SHA1 (patch-bin_elasticsearch-plugin) = 56db071765b91a4846e1529b5fe8be2c549b449d
 SHA1 (patch-config_elasticsearch.yml) = 8a59f9123b8bc1c40d17131dc51c361fa210c17c



Home | Main Index | Thread Index | Old Index