pkgsrc-Changes-HG archive

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]

[pkgsrc/trunk]: pkgsrc/databases/elasticsearch databases/elasticsearch: Updat...



details:   https://anonhg.NetBSD.org/pkgsrc/rev/d7799d71a5f7
branches:  trunk
changeset: 375276:d7799d71a5f7
user:      fhajny <fhajny%pkgsrc.org@localhost>
date:      Wed Feb 07 16:26:16 2018 +0000

description:
databases/elasticsearch: Update to 6.2.0.

6.2.0

=== Breaking changes

Aggregations::
- Add a new cluster setting to limit the total number of buckets
  returned by a request

Core::
- Forbid granting the all permission in production

Highlighting::
- Limit the analyzed text for highlighting

Search::
- Introduce limit to the number of terms in Terms Query


=== Breaking Java changes

Java API::
- Remove `operationThreaded` from Java API

Java High Level REST Client::
- REST high-level client: remove index suffix from indices client
  method names


=== Deprecations

Analysis::
- Backport delimited payload filter renaming

Suggesters::
- deprecating `jarowinkler` in favor of `jaro_winkler`
- Deprecating `levenstein` in favor of `levensHtein`


=== New features

Plugin Ingest GeoIp::
- Enable ASN support for Ingest GeoIP plugin.

Plugin Lang Painless::
- Painless: Add spi jar that will be published for extending
  whitelists
- Painless: Add a simple cache for whitelist methods and fields.

Plugins::
- Add the ability to bundle multiple plugins into a meta plugin

Rank Evaluation::
- Backport of ranking evaluation API (#27478)

Recovery::
- Backport for using lastSyncedGlobalCheckpoint in deletion policy

Reindex API::
- Add scroll parameter to _reindex API


=== Enhancements

Allocation::
- Fix cluster.routing.allocation.enable and
  cluster.routing.rebalance.enable case
- Add node id to shard failure message

Analysis::
- Limit the analyzed text for highlighting (#27934)
- Allow TrimFilter to be used in custom normalizers

Circuit Breakers::
- Add accounting circuit breaker and track segment memory usage

Cluster::
- Adds wait_for_no_initializing_shards to cluster health API

Core::
- Introduce elasticsearch-core jar
- Rename core module to server
- Introduce elasticsearch-core jar
- Add Writeable.Reader support to TransportResponseHandler
- Simplify rejected execution exception
- Add node name to thread pool executor name

Discovery::
- Add information when master node left to DiscoveryNodes'
  shortSummary()

Engine::
- Move uid lock into LiveVersionMap
- Optimize version map for append-only indexing

Geo::
- [GEO] Add WKT Support to GeoBoundingBoxQueryBuilder
- [Geo] Add Well Known Text (WKT) Parsing Support to ShapeBuilders

Highlighting::
- Include all sentences smaller than fragment_size in the unified
  highlighter

Ingest::
- Enable convert processor to support Long and Double

Internal::
- Make KeyedLock reentrant
- Make AbstractQueryBuilder.declareStandardFields to be protected
- Tighten the CountedBitSet class
- Avoid doing redundant work when checking for self references.

Java API::
- Add missing delegate methods to NodeIndicesStats
- Java api clean-up : consistency for `shards_acknowledged` getters

Java High Level REST Client::
- add toString implementation for UpdateRequest.
- Add Close Index API to the high level REST client
- Add Open Index API to the high level REST client
- Added Create Index support to high-level REST client
- Add multi get api to the high level rest client
- Add msearch api to high level client

Mapping::
- Allow `_doc` as a type.

Network::
- Add NioGroup for use in different transports
- Add read timeouts to http module
- Implement byte array reusage in `NioTransport`
- Introduce resizable inbound byte buffer
- Decouple nio constructs from the tcp transport

Packaging::
- Extend JVM options to support multiple versions
- Add explicit coreutils dependency
- Detect mktemp from coreutils
- Enable GC logs by default
- Use private directory for temporary files

Percolator::
- also extract match_all queries when indexing percolator queries

Plugin Lang Painless::
- Painless: Add whitelist extensions
- Painless: Modify Loader to Load Classes Directly from Definition
- Clean Up Painless Cast Object
- Painless: Only allow Painless type names to be the same as the
  equivalent Java class.

Plugins::
- Add client actions to action plugin
- Plugins: Add validation to plugin descriptor parsing
- Plugins: Add plugin extension capabilities
- Add support for filtering mappings fields

Rank Evaluation::
- Simplify RankEvalResponse output

Recovery::
- Truncate tlog cli should assign global checkpoint
- Replica starts peer recovery with safe commit
- Primary send safe commit in file-based recovery
- Fail resync-failed shards in subsequent writes
- Introduce promoting index shard state
- Non-peer recovery should set the global checkpoint
- Persist global checkpoint when finalizing a peer recovery
- Rollback a primary before recovering from translog

Rollover::
- Fail rollover if duplicated alias found in templates

Search::
- Use typeName() to check field type in GeoShapeQueryBuilder
- Optimize search_after when sorting in index sort order

Sequence IDs::
- Do not keep 5.x commits when having 6.x commits
- Use lastSyncedGlobalCheckpoint in deletion policy
- Use CountedBitSet in LocalCheckpointTracker
- Only fsync global checkpoint if needed
- Keep commits and translog up to the global checkpoint
- Adjust CombinedDeletionPolicy for multiple commits
- Keeps index commits up to the current global checkpoint
- Dedup translog operations by reading in reverse

Settings::
- Add validation of keystore setting names

Snapshot/Restore::
- Use AmazonS3.doesObjectExist() method in S3BlobContainer
- Remove XContentType auto detection in BlobStoreRepository
- Include include_global_state in Snapshot status API (#22423)

Task Manager::
- Add ability to associate an ID with tasks

Translog::
- Simplify MultiSnapshot#SeqNoset
- Enclose CombinedDeletionPolicy in SnapshotDeletionPolicy


=== Bug fixes

Aggregations::
- Adds metadata to rewritten aggregations
- Fix NPE on composite aggregation with sub-aggregations that need
  scores
- StringTerms.Bucket.getKeyAsNumber detection type
- Fix incorrect results for aggregations nested under a nested
  aggregation
- Fix global aggregation that requires breadth first and scores
- Fix composite aggregation when after term is missing in the shard
- Fix preserving FiltersAggregationBuilder#keyed field on rewrite
- Using DocValueFormat::parseBytesRef for parsing missing value
  parameter
- Fix illegal cast of the "low cardinality" optimization of the
  `terms` aggregation.
- Always include the _index and _id for nested search hits.

Allocation::
- Do not open indices with broken settings

Core::
- Fix lock accounting in releasable lock
- Fixes ByteSizeValue to serialise correctly
- Do not set data paths on no local storage required
- Ensure threadcontext is preserved when refresh listeners are invoked
- Ensure logging is configured for CLI commands

Engine::
- Replica recovery could go into an endless flushing loop
- Use `_refresh` to shrink the version map on inactivity
- Allow resize version map under lock even if there are pending
  operations
- Reset LiveVersionMap on sync commit

Geo::
- Correct two equality checks on incomparable types
- Handle case where the hole vertex is south of the containing
  polygon(s)

Highlighting::
- Fix highlighting on a keyword field that defines a normalizer

Inner Hits::
- Add version support for inner hits in field collapsing (#27822)

Internal::
- Never return null from Strings.tokenizeToStringArray
- Fallback to TransportMasterNodeAction for cluster health retries
- Retain originalIndex info when rewriting FieldCapabilities requests

Java REST Client::
- Do not use system properties when building the HttpAsyncClient

Mapping::
- Ignore null value for range field (#27845)
- Pass `java.locale.providers=COMPAT` to Java 9 onwards
- Allow update of `eager_global_ordinals` on `_parent`.
- Fix merging of _meta field

Network::
- Only bind loopback addresses when binding to local
- Remove potential nio selector leak
- Fix issue where the incorrect buffers are written
- Throw UOE from compressible bytes stream reset
- Bubble exceptions when closing compressible streams

Packaging::
- Allow custom service names when installing on windows

Percolator::
- Avoid TooManyClauses exception if number of terms / ranges is
  exactly equal to 1024

Plugin Analysis ICU::
- Catch InvalidPathException in IcuCollationTokenFilterFactory

Plugin Analysis Phonetic::
- Fix daitch_mokotoff phonetic filter to use the dedicated Lucene
  filter

Plugin Lang Painless::
- Painless: Fix variable scoping issue in lambdas
- Painless: Fix errors allowing void to be assigned to def.

Plugin Repository HDFS::
- Fix SecurityException when HDFS Repository used against HA Namenodes

Plugins::
- Make sure that we don't detect files as maven coordinate when
  installing a plugin
- Fix upgrading indices which use a custom similarity plugin.

Recovery::
- Open engine should keep only starting commit
- Allow shrinking of indices from a previous major
- Set global checkpoint before open engine from store
- Check and repair index under the store metadata lock
- Flush old indices on primary promotion and relocation

Rollover::
- Make index rollover action atomic

Scripting::
- Ensure we protect Collections obtained from scripts from
  self-referencing

Scroll::
- Reject scroll query if size is 0 (#22552)
- Fix scroll query with a sort that is a prefix of the index sort

Search::
- Fix simple_query_string on invalid input
- Use the underlying connection version for CCS connections
- Fix synonym phrase query expansion for cross_fields parsing
- Carry forward weights, etc on rescore rewrite
- Fix routing with leading or trailing whitespace

Sequence IDs::
- Recovery from snapshot may leave seq# gaps
- No longer unidle shard during recovery
- Obey translog durability in global checkpoint sync

Settings::
- Settings: Introduce settings updater for a list of settings
- Fix setting notification for complex setting (affixMap settings)
  that could cause transient settings to be ignored
- Fix environment variable substitutions in list setting
- Allow index settings to be reset by wildcards

Snapshot/Restore::
- Consistent updates of IndexShardSnapshotStatus
- Avoid concurrent snapshot finalizations when deleting an INIT
  snapshot
- Do not start snapshots that are deleted during initialization
- Do not swallow exception in ChecksumBlobStoreFormat.writeAtomic()
- Consistent update of stage and failure message in
  IndexShardSnapshotStatus
- Fail restore when the shard allocations max retries count is reached
- Delete shard store files before restoring a snapshot

Stats::
- Fixes DocStats to properly deal with shards that report -1 index
  size
- Include internal refreshes in refresh stats

Term Vectors::
- Fix term vectors generator with keyword and normalizer


=== Upgrades

Core::
- Dependencies: Update joda time to 2.9.9
- upgrade to lucene 7.2.1
- Upgrade jna from 4.4.0-1 to 4.5.1

Ingest::
- update ingest-attachment to use Tika 1.17 and newer deps





6.1.3

Engine::
- Replica recovery could go into an endless flushing loop

Internal::
- Never return null from Strings.tokenizeToStringArray
- Fallback to TransportMasterNodeAction for cluster health retries

Mapping::
- Allow update of `eager_global_ordinals` on `_parent`.

Scripting::
- Ensure we protect Collections obtained from scripts from
  self-referencing

Settings::
- Fix setting notification for complex setting (affixMap settings)
  that could cause transient settings to be ignored
- Fix environment variable substitutions in list setting

Snapshot/Restore::
- Avoid concurrent snapshot finalizations when deleting an INIT
  snapshot
- Do not start snapshots that are deleted during initialization

diffstat:

 databases/elasticsearch/Makefile |   4 +-
 databases/elasticsearch/PLIST    |  59 +++++++++++++++++++++------------------
 databases/elasticsearch/distinfo |  10 +++---
 3 files changed, 39 insertions(+), 34 deletions(-)

diffs (140 lines):

diff -r 874a5c8e59a3 -r d7799d71a5f7 databases/elasticsearch/Makefile
--- a/databases/elasticsearch/Makefile  Wed Feb 07 16:14:47 2018 +0000
+++ b/databases/elasticsearch/Makefile  Wed Feb 07 16:26:16 2018 +0000
@@ -1,6 +1,6 @@
-# $NetBSD: Makefile,v 1.39 2018/01/22 19:27:21 fhajny Exp $
+# $NetBSD: Makefile,v 1.40 2018/02/07 16:26:16 fhajny Exp $
 
-DISTNAME=      elasticsearch-6.1.2
+DISTNAME=      elasticsearch-6.2.0
 CATEGORIES=    textproc
 MASTER_SITES=  https://artifacts.elastic.co/downloads/elasticsearch/
 
diff -r 874a5c8e59a3 -r d7799d71a5f7 databases/elasticsearch/PLIST
--- a/databases/elasticsearch/PLIST     Wed Feb 07 16:14:47 2018 +0000
+++ b/databases/elasticsearch/PLIST     Wed Feb 07 16:26:16 2018 +0000
@@ -1,4 +1,4 @@
-@comment $NetBSD: PLIST,v 1.26 2018/01/22 19:27:21 fhajny Exp $
+@comment $NetBSD: PLIST,v 1.27 2018/02/07 16:26:16 fhajny Exp $
 bin/elasticsearch
 bin/elasticsearch-plugin
 lib/elasticsearch/bin/elasticsearch-env
@@ -7,34 +7,36 @@
 lib/elasticsearch/lib/HdrHistogram-2.1.9.jar
 lib/elasticsearch/lib/${PKGNAME}.jar
 lib/elasticsearch/lib/elasticsearch-cli-${PKGVERSION}.jar
+lib/elasticsearch/lib/elasticsearch-core-${PKGVERSION}.jar
+lib/elasticsearch/lib/elasticsearch-launchers-${PKGVERSION}.jar
 lib/elasticsearch/lib/hppc-0.7.1.jar
 lib/elasticsearch/lib/jackson-core-2.8.10.jar
 lib/elasticsearch/lib/jackson-dataformat-cbor-2.8.10.jar
 lib/elasticsearch/lib/jackson-dataformat-smile-2.8.10.jar
 lib/elasticsearch/lib/jackson-dataformat-yaml-2.8.10.jar
-lib/elasticsearch/lib/java-version-checker-${PKGVERSION}.jar
-lib/elasticsearch/lib/jna-4.4.0-1.jar
-lib/elasticsearch/lib/joda-time-2.9.5.jar
+lib/elasticsearch/lib/jna-4.5.1.jar
+lib/elasticsearch/lib/joda-time-2.9.9.jar
 lib/elasticsearch/lib/jopt-simple-5.0.2.jar
 lib/elasticsearch/lib/jts-1.13.jar
 lib/elasticsearch/lib/log4j-1.2-api-2.9.1.jar
 lib/elasticsearch/lib/log4j-api-2.9.1.jar
 lib/elasticsearch/lib/log4j-core-2.9.1.jar
-lib/elasticsearch/lib/lucene-analyzers-common-7.1.0.jar
-lib/elasticsearch/lib/lucene-backward-codecs-7.1.0.jar
-lib/elasticsearch/lib/lucene-core-7.1.0.jar
-lib/elasticsearch/lib/lucene-grouping-7.1.0.jar
-lib/elasticsearch/lib/lucene-highlighter-7.1.0.jar
-lib/elasticsearch/lib/lucene-join-7.1.0.jar
-lib/elasticsearch/lib/lucene-memory-7.1.0.jar
-lib/elasticsearch/lib/lucene-misc-7.1.0.jar
-lib/elasticsearch/lib/lucene-queries-7.1.0.jar
-lib/elasticsearch/lib/lucene-queryparser-7.1.0.jar
-lib/elasticsearch/lib/lucene-sandbox-7.1.0.jar
-lib/elasticsearch/lib/lucene-spatial-7.1.0.jar
-lib/elasticsearch/lib/lucene-spatial-extras-7.1.0.jar
-lib/elasticsearch/lib/lucene-spatial3d-7.1.0.jar
-lib/elasticsearch/lib/lucene-suggest-7.1.0.jar
+lib/elasticsearch/lib/lucene-analyzers-common-7.2.1.jar
+lib/elasticsearch/lib/lucene-backward-codecs-7.2.1.jar
+lib/elasticsearch/lib/lucene-core-7.2.1.jar
+lib/elasticsearch/lib/lucene-grouping-7.2.1.jar
+lib/elasticsearch/lib/lucene-highlighter-7.2.1.jar
+lib/elasticsearch/lib/lucene-join-7.2.1.jar
+lib/elasticsearch/lib/lucene-memory-7.2.1.jar
+lib/elasticsearch/lib/lucene-misc-7.2.1.jar
+lib/elasticsearch/lib/lucene-queries-7.2.1.jar
+lib/elasticsearch/lib/lucene-queryparser-7.2.1.jar
+lib/elasticsearch/lib/lucene-sandbox-7.2.1.jar
+lib/elasticsearch/lib/lucene-spatial-7.2.1.jar
+lib/elasticsearch/lib/lucene-spatial-extras-7.2.1.jar
+lib/elasticsearch/lib/lucene-spatial3d-7.2.1.jar
+lib/elasticsearch/lib/lucene-suggest-7.2.1.jar
+lib/elasticsearch/lib/plugin-classloader-${PKGVERSION}.jar
 lib/elasticsearch/lib/plugin-cli-${PKGVERSION}.jar
 lib/elasticsearch/lib/securesm-1.2.jar
 lib/elasticsearch/lib/snakeyaml-1.17.jar
@@ -53,7 +55,7 @@
 lib/elasticsearch/modules/lang-expression/asm-commons-5.0.4.jar
 lib/elasticsearch/modules/lang-expression/asm-tree-5.0.4.jar
 lib/elasticsearch/modules/lang-expression/lang-expression-${PKGVERSION}.jar
-lib/elasticsearch/modules/lang-expression/lucene-expressions-7.1.0.jar
+lib/elasticsearch/modules/lang-expression/lucene-expressions-7.2.1.jar
 lib/elasticsearch/modules/lang-expression/plugin-descriptor.properties
 lib/elasticsearch/modules/lang-expression/plugin-security.policy
 lib/elasticsearch/modules/lang-mustache/compiler-0.9.3.jar
@@ -62,6 +64,7 @@
 lib/elasticsearch/modules/lang-mustache/plugin-security.policy
 lib/elasticsearch/modules/lang-painless/antlr4-runtime-4.5.3.jar
 lib/elasticsearch/modules/lang-painless/asm-debug-all-5.1.jar
+lib/elasticsearch/modules/lang-painless/elasticsearch-scripting-painless-spi-${PKGVERSION}.jar
 lib/elasticsearch/modules/lang-painless/lang-painless-${PKGVERSION}.jar
 lib/elasticsearch/modules/lang-painless/plugin-descriptor.properties
 lib/elasticsearch/modules/lang-painless/plugin-security.policy
@@ -71,6 +74,8 @@
 lib/elasticsearch/modules/parent-join/plugin-descriptor.properties
 lib/elasticsearch/modules/percolator/percolator-${PKGVERSION}.jar
 lib/elasticsearch/modules/percolator/plugin-descriptor.properties
+lib/elasticsearch/modules/rank-eval/plugin-descriptor.properties
+lib/elasticsearch/modules/rank-eval/rank-eval-${PKGVERSION}.jar
 lib/elasticsearch/modules/reindex/commons-codec-1.10.jar
 lib/elasticsearch/modules/reindex/commons-logging-1.1.3.jar
 lib/elasticsearch/modules/reindex/elasticsearch-rest-client-${PKGVERSION}.jar
@@ -84,13 +89,13 @@
 lib/elasticsearch/modules/repository-url/plugin-descriptor.properties
 lib/elasticsearch/modules/repository-url/plugin-security.policy
 lib/elasticsearch/modules/repository-url/repository-url-${PKGVERSION}.jar
-lib/elasticsearch/modules/transport-netty4/netty-buffer-4.1.13.Final.jar
-lib/elasticsearch/modules/transport-netty4/netty-codec-4.1.13.Final.jar
-lib/elasticsearch/modules/transport-netty4/netty-codec-http-4.1.13.Final.jar
-lib/elasticsearch/modules/transport-netty4/netty-common-4.1.13.Final.jar
-lib/elasticsearch/modules/transport-netty4/netty-handler-4.1.13.Final.jar
-lib/elasticsearch/modules/transport-netty4/netty-resolver-4.1.13.Final.jar
-lib/elasticsearch/modules/transport-netty4/netty-transport-4.1.13.Final.jar
+lib/elasticsearch/modules/transport-netty4/netty-buffer-4.1.16.Final.jar
+lib/elasticsearch/modules/transport-netty4/netty-codec-4.1.16.Final.jar
+lib/elasticsearch/modules/transport-netty4/netty-codec-http-4.1.16.Final.jar
+lib/elasticsearch/modules/transport-netty4/netty-common-4.1.16.Final.jar
+lib/elasticsearch/modules/transport-netty4/netty-handler-4.1.16.Final.jar
+lib/elasticsearch/modules/transport-netty4/netty-resolver-4.1.16.Final.jar
+lib/elasticsearch/modules/transport-netty4/netty-transport-4.1.16.Final.jar
 lib/elasticsearch/modules/transport-netty4/plugin-descriptor.properties
 lib/elasticsearch/modules/transport-netty4/plugin-security.policy
 lib/elasticsearch/modules/transport-netty4/transport-netty4-${PKGVERSION}.jar
diff -r 874a5c8e59a3 -r d7799d71a5f7 databases/elasticsearch/distinfo
--- a/databases/elasticsearch/distinfo  Wed Feb 07 16:14:47 2018 +0000
+++ b/databases/elasticsearch/distinfo  Wed Feb 07 16:26:16 2018 +0000
@@ -1,8 +1,8 @@
-$NetBSD: distinfo,v 1.40 2018/01/22 19:27:21 fhajny Exp $
+$NetBSD: distinfo,v 1.41 2018/02/07 16:26:16 fhajny Exp $
 
-SHA1 (elasticsearch-6.1.2.tar.gz) = 78de1f9b1b397fdfd7a50625bad02481ce4f7e85
-RMD160 (elasticsearch-6.1.2.tar.gz) = 82fe3faf1f6eb2208d2e62e254277df4068efba2
-SHA512 (elasticsearch-6.1.2.tar.gz) = c72e69700b60faf3b1a542c2317b83189926738affb38033c4b8d7cc0a1b3c21c4f743f441fb10657d4684111746ebb18c9dba2f54845ea6e02e4fb8dc950e5a
-Size (elasticsearch-6.1.2.tar.gz) = 28455845 bytes
+SHA1 (elasticsearch-6.2.0.tar.gz) = 05f8527be810d45888a00f69edee5c73a13b737c
+RMD160 (elasticsearch-6.2.0.tar.gz) = 4ea13b8681c2439cf64fe648615a3530bc8f2693
+SHA512 (elasticsearch-6.2.0.tar.gz) = a6b5e36b09a8d2c1f3a744036937b4d66df01f3a789ea7d255654d3389a0c5ef3667b52a406cf31dc3abcc2a874a25636a816b0a3c8a157a8deea7f58df95297
+Size (elasticsearch-6.2.0.tar.gz) = 29047381 bytes
 SHA1 (patch-bin_elasticsearch-env) = 7d8f71c6c1a99168cc4a7322e054ddc8fe94b68e
 SHA1 (patch-config_elasticsearch.yml) = f66dad65dec48a45a4d52b685d6e3ab29de62cf2



Home | Main Index | Thread Index | Old Index