pkgsrc-Changes-HG archive

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]

[pkgsrc/trunk]: pkgsrc/databases/elasticsearch Update databases/elasticsearch...



details:   https://anonhg.NetBSD.org/pkgsrc/rev/3d00747fb171
branches:  trunk
changeset: 356661:3d00747fb171
user:      fhajny <fhajny%pkgsrc.org@localhost>
date:      Tue Jan 03 09:05:33 2017 +0000

description:
Update databases/elasticsearch to 5.1.1.

== 5.1.1 Release Notes

=== Breaking changes

Aliases::
- Validate alias names the same as index names

REST::
- Remove lenient stats parsing 5.x


=== Breaking Java changes

Discovery::
- Remove pluggability of ElectMasterService

Exceptions::
- Remove `IndexTemplateAlreadyExistsException` and
  `IndexShardAlreadyExistsException`
- Replace IndexAlreadyExistsException with
  ResourceAlreadyExistsException
- Backport: Replace IndexAlreadyExistsException with
  ResourceAlreadyExistsException

Internal::
- Pass executor name to request interceptor to support async intercept
  calls

Network::
- Unguice Transport and friends

Plugins::
- Plugins: Remove support for onModule


=== Deprecations

Analysis::
- Deprecating request parameters of _analyze API in 5.x

CRUD::
- Deprecate VersionType.FORCE

Core::
- Add deprecation logging for users that explicitly opt in for the
  `default` fs type.

Mapping::
- Deprecate `timestamp` and `ttl` on index requests.

Query DSL::
- Add deprecation logging for lenient boolean queries
- Add deprecation logging message for 'fuzzy' query

Search::
- Deprecate ignored type parameter in search_shards api

Settings::
- Add deprecation logging for the case that store throttling is used.


=== New features

Analysis::
- Expose Lucenes Ukrainian analyzer

CAT API::
- Provides a cat api endpoint for templates.

Query DSL::
- Add "all fields" execution mode to simple_query_string query
- Add support for `quote_field_suffix` to `simple_query_string`.
- Add "all field" execution mode to query_string query

Reindex API::
- Add automatic parallelization support to reindex and friends


=== Enhancements

Aggregations::
- Rescorer should be applied in the TopHits aggregation

Allocation::
- Balance step in BalancedShardsAllocator for a single shard
- Process more expensive allocation deciders last
- Separates decision making from decision application in
  BalancedShardsAllocator
- Split allocator decision making from decision application

Analysis::
- Remove AnalysisService and reduce it to a simple name to analyzer
  mapping

CAT API::
- Adding built-in sorting capability to _cat apis.
- Add health status parameter to cat indices API

Cache::
- Do not cache term queries.
- Parse alias filters on the coordinating node

Cluster::
- Cache successful shard deletion checks

Core::
- Reduce memory pressure when sending large terms queries.
- Install a security manager on startup
- Log node ID on startup
- Ensure source filtering automatons are only compiled once
- Improve scheduling fairness when batching cluster state changes with
  equal priority
- Do not log full bootstrap checks exception

Exceptions::
- Add BWC layer for Exceptions

Geo::
- Optimize geo-distance sorting.

Ingest::
- add `ignore_missing` option to SplitProcessor

Internal::
- Rename ClusterState#lookupPrototypeSafe to `lookupPrototype` and
  remove "unsafe" unused variant
- ShardActiveResponseHandler shouldn't hold to an entire cluster state
- Remove unused ClusterService dependency from SearchPhaseController
- Remove special case in case no action filters are registered
- Use TimveValue instead of long for CacheBuilder methods
- Remove SearchContext#current and all it's threadlocals

Java REST Client::
- Provide error message when rest request path is null

Logging::
- Log failure to connect to node at info instead of debug
- Truncate log messages from the end
- Logging shutdown hack
- Disable console logging

Mapping::
- Create the QueryShardContext lazily in DocumentMapperParser.

Network::
- Grant Netty permission to read system somaxconn
- Lazy resolve unicast hosts
- Fix handler name on message not fully read
- Handle rejected pings on shutdown gracefully

Packaging::
- Add empty plugins dir for archive distributions
- Make explicit missing settings for Windows service
- Change permissions on config files

Plugin Lang Painless::
- Add Debug.explain to painless
- Implement the ?: operator in painless
- In painless suggest a long constant if int won't do
- Support decimal constants with trailing [dD] in painless
- Implement reading from null safe dereferences
- Painless negative offsets

Plugin Repository S3::
- Make the default S3 buffer size depend on the available memory.

Plugins::
- Clarify that plugins can be closed
- Plugins: Convert custom discovery to pull based plugin
- Removing plugin that isn't installed shouldn't trigger usage
  information
- Remove pluggability of ZenPing
- Make UnicastHostsProvider extension pull based

Query DSL::
- Using ObjectParser in MatchAllQueryBuilder and IdsQueryBuilder
- Expose splitOnWhitespace in `Query String Query`
- Throw error if query element doesn't end with END_OBJECT
- Remove `lowercase_expanded_terms` and `locale` from query-parser
  options.

Reindex API::
- Make reindex-from-remote ignore unknown fields

Scripting::
- Wrap VerifyError in ScriptException
- Support binary field type in script values
- Mustache: Add
- Expose `ctx._now` in update scripts

Search::
- Add indices and filter information to search shards api output
- remove pointless catch exception in TransportSearchAction
- Optimize query with types filter in the URL (t/t/_search)
- Makes search action cancelable by task management API

Search Templates::
- Add profile and explain parameters to template API

Snapshot/Restore::
- Abort snapshots on a node that leaves the cluster

Stats::
- Remove load average leniency
- Strengthen handling of unavailable cgroup stats
- Add basic cgroup CPU metrics

Task Manager::
- Add search task descriptions

Tribe Node::
- Add support for merging custom meta data in tribe node


=== Bug fixes

Aggregations::
- Rewrite Queries/Filter in FilterAggregationBuilder and ensure client
  usage marks query as non-cachable
- Percentiles bucket fails for 100th percentile
- Thread safety for scripted significance heuristics

Allocation::
- Allow master to assign primary shard to node that has shard store
  locked during shard state fetching

Analysis::
- Can load non-PreBuiltTokenFilter in Analyze API

CAT API::
- Consume `full_id` request parameter early

Cache::
- Fix the request cache keys to not hold references to the
  SearchContext.

Circuit Breakers::
- ClusterState publishing shouldn't trigger circuit breakers

Cluster::
- Remove cluster update task when task times out

Core::
- Add a StreamInput#readArraySize method that ensures sane array sizes
- Use a buffer to do character to byte conversion in
  StreamOutput#writeString
- Fix ShardInfo#toString
- Protect BytesStreamOutput against overflows of the current number of
  written bytes.
- Return target index name even if _rollover conditions are not met
- .es_temp_file remains after system crash, causing it not to start
  again

Dates::
- Fix time zone rounding edge case for DST overlaps

Engine::
- Die with dignity on the Lucene layer
- Fix `InternalEngine#isThrottled` to not always return `false`.
- Retrying replication requests on replica doesn't call `onRetry`

Highlighting::
- Fix FiltersFunctionScoreQuery highlighting
- Fix highlighting on a stored keyword field

Index APIs::
- Validate the `_rollover` target index name early to also fail if
  dry_run=true

Index Templates::
- Fix integer overflows when dealing with templates.

Ingest::
- fix trace_match behavior for when there is only one grok pattern
- Stored scripts and ingest node configurations should be included into
  a snapshot

Inner Hits::
- Skip adding a parent field to nested documents.

Internal::
- Rethrow ExecutionException from the loader to concurrent callers of
  Cache#computeIfAbsent
- Restore thread's original context before returning to the ThreadPool
- Fix NPE in SearchContext.toString()
- Source filtering should treat dots in field names as sub objects.

Java API::
- Transport client: Fix remove address to actually work
- Add a HostFailureListener to notify client code if a node got
  disconnected
- Fix InternalSearchHit#hasSource to return the proper boolean value
- Null checked for source when calling sourceRef
- ClusterAdminClient.prepareDeletePipeline method should accept pipeline
  id to delete

Java REST Client::
- Rest client: don't reuse the same HttpAsyncResponseConsumer across
  multiple retries

Logging::
- Do not prematurely shutdown Log4j
- Assert status logger does not warn on Log4j usage
- Fix logger names for Netty

Mapping::
- Fail to index fields with dots in field names when one of the
  intermediate objects is nested.
- Uncommitted mapping updates should not efect existing indices

Network::
- DiscoveryNode and TransportAddress should preserve host information
- Die with dignity on the network layer
- Prevent double release in TcpTransport if send listener throws an
  exception

Packaging::
- Set vm.max_map_count on systemd package install
- Export ES_JVM_OPTIONS for SysV init
- Debian: configure start-stop-daemon to not go into background
- Generate POM files with non-wildcard excludes

Plugin Lang Painless::
- Test fix for def equals in Painless
- Fix a VerifyError bug in Painless
- Fix Lambdas in Painless to be Able to Use Top-Level Variables Such as
  params and doc

Plugin Mapper Attachment::
- NPE is raised when defining a non existing type within attachments
  type

Query DSL::
- Fixes date range query using epoch with timezone
- Allow overriding all-field leniency when `lenient` option is specified
- Max score should be updated when a rescorer is used

REST::
- Strict level parsing for indices stats
- The routing query string param is supported by mget but was missing
  from the rest spec
- fix thread_pool_patterns path variable definition
- ensure the XContentBuilder is always closed in RestBuilderListener
- XContentBuilder: Avoid building self-referencing objects

Reindex API::
- Ignore IllegalArgumentException with assertVersionSerializable
- Bump reindex-from-remote's buffer to 200mb
- Fix reindex-from-remote for parent/child from <2.0

Search::
- Fix match_phrase_prefix on boosted fields
- Respect default search timeout
- Remove LateParsingQuery to prevent timestamp access after context is
  frozen

Search Templates::
- SearchTemplateRequest to implement CompositeIndicesRequest

Settings::
- Handle spaces in `action.auto_create_index` gracefully
- Fix settings diff generation for affix and group settings
- Don't reset non-dynamic settings unless explicitly requested

Snapshot/Restore::
- Fixes shard level snapshot metadata loading when index-N file is
  missing
- Ensures cleanup of temporary index-* generational blobs during
  snapshotting
- Fixes get snapshot duplicates when asking for _all
- Keep snapshot restore state and routing table in sync (5.x backport)

Task Manager::
- Task cancellation command should wait for all child nodes to receive
  cancellation request before returning

Tribe Node::
- Add socket permissions for tribe nodes


=== Upgrades

Core::
- Upgrade to lucene-6.3.0.

Dates::
- Update Joda Time to version 2.9.5

Logging::
- Upgrade Log4j 2 to version 2.7

Network::
- Upgrade to Netty 4.1.6

Plugin Ingest Attachment::
- Update to Tika 1.14



== 5.0.2 Release Notes

=== Enhancements

Core::
- Install a security manager on startup

Exceptions::
- Add BWC layer for Exceptions

Logging::
- Truncate log messages from the end

Scripting::
- Wrap VerifyError in ScriptException

Snapshot/Restore::
- Abort snapshots on a node that leaves the cluster


=== Bug fixes

Allocation::
- Allow master to assign primary shard to node that has shard store
  locked during shard state fetching

Cluster::
- Remove cluster update task when task times out

Core::
- Add a StreamInput#readArraySize method that ensures sane array sizes
- Use a buffer to do character to byte conversion in
  StreamOutput#writeString

Engine::
- Die with dignity on the Lucene layer
- Fix `InternalEngine#isThrottled` to not always return `false`.

Index Templates::
- Fix integer overflows when dealing with templates.

Ingest::
- fix trace_match behavior for when there is only one grok pattern

Internal::
- Rethrow ExecutionException from the loader to concurrent callers of
  Cache#computeIfAbsent
- Fixes potential NullPointerException on shard closing

Java API::
- Transport client: Fix remove address to actually work
- Add a HostFailureListener to notify client code if a node got
  disconnected

Logging::
- Do not prematurely shutdown Log4j

Network::
- Die with dignity on the network layer

Plugin Lang Painless::
- Fix a VerifyError bug in Painless
- Fix Lambdas in Painless to be Able to Use Top-Level Variables Such as
  params and doc

Search::
- Respect default search timeout

Settings::
- Don't reset non-dynamic settings unless explicitly requested

Tribe Node::
- Add socket permissions for tribe nodes

diffstat:

 databases/elasticsearch/Makefile |   4 +-
 databases/elasticsearch/PLIST    |  57 +++++++++++++++++++--------------------
 databases/elasticsearch/distinfo |  10 +++---
 3 files changed, 35 insertions(+), 36 deletions(-)

diffs (117 lines):

diff -r e176baaaeae5 -r 3d00747fb171 databases/elasticsearch/Makefile
--- a/databases/elasticsearch/Makefile  Tue Jan 03 08:54:17 2017 +0000
+++ b/databases/elasticsearch/Makefile  Tue Jan 03 09:05:33 2017 +0000
@@ -1,6 +1,6 @@
-# $NetBSD: Makefile,v 1.21 2016/12/05 10:51:03 fhajny Exp $
+# $NetBSD: Makefile,v 1.22 2017/01/03 09:05:33 fhajny Exp $
 
-DISTNAME=      elasticsearch-5.0.2
+DISTNAME=      elasticsearch-5.1.1
 CATEGORIES=    textproc
 MASTER_SITES=  https://artifacts.elastic.co/downloads/elasticsearch/
 
diff -r e176baaaeae5 -r 3d00747fb171 databases/elasticsearch/PLIST
--- a/databases/elasticsearch/PLIST     Tue Jan 03 08:54:17 2017 +0000
+++ b/databases/elasticsearch/PLIST     Tue Jan 03 09:05:33 2017 +0000
@@ -1,4 +1,4 @@
-@comment $NetBSD: PLIST,v 1.13 2016/11/08 09:18:00 fhajny Exp $
+@comment $NetBSD: PLIST,v 1.14 2017/01/03 09:05:33 fhajny Exp $
 bin/elasticsearch
 bin/elasticsearch-plugin
 lib/elasticsearch/bin/elasticsearch.in.sh
@@ -10,28 +10,27 @@
 lib/elasticsearch/lib/jackson-dataformat-smile-2.8.1.jar
 lib/elasticsearch/lib/jackson-dataformat-yaml-2.8.1.jar
 lib/elasticsearch/lib/jna-4.2.2.jar
-lib/elasticsearch/lib/joda-convert-1.2.jar
-lib/elasticsearch/lib/joda-time-2.9.4.jar
+lib/elasticsearch/lib/joda-time-2.9.5.jar
 lib/elasticsearch/lib/jopt-simple-5.0.2.jar
 lib/elasticsearch/lib/jts-1.13.jar
-lib/elasticsearch/lib/log4j-1.2-api-2.6.2.jar
-lib/elasticsearch/lib/log4j-api-2.6.2.jar
-lib/elasticsearch/lib/log4j-core-2.6.2.jar
-lib/elasticsearch/lib/lucene-analyzers-common-6.2.0.jar
-lib/elasticsearch/lib/lucene-backward-codecs-6.2.0.jar
-lib/elasticsearch/lib/lucene-core-6.2.0.jar
-lib/elasticsearch/lib/lucene-grouping-6.2.0.jar
-lib/elasticsearch/lib/lucene-highlighter-6.2.0.jar
-lib/elasticsearch/lib/lucene-join-6.2.0.jar
-lib/elasticsearch/lib/lucene-memory-6.2.0.jar
-lib/elasticsearch/lib/lucene-misc-6.2.0.jar
-lib/elasticsearch/lib/lucene-queries-6.2.0.jar
-lib/elasticsearch/lib/lucene-queryparser-6.2.0.jar
-lib/elasticsearch/lib/lucene-sandbox-6.2.0.jar
-lib/elasticsearch/lib/lucene-spatial-6.2.0.jar
-lib/elasticsearch/lib/lucene-spatial-extras-6.2.0.jar
-lib/elasticsearch/lib/lucene-spatial3d-6.2.0.jar
-lib/elasticsearch/lib/lucene-suggest-6.2.0.jar
+lib/elasticsearch/lib/log4j-1.2-api-2.7.jar
+lib/elasticsearch/lib/log4j-api-2.7.jar
+lib/elasticsearch/lib/log4j-core-2.7.jar
+lib/elasticsearch/lib/lucene-analyzers-common-6.3.0.jar
+lib/elasticsearch/lib/lucene-backward-codecs-6.3.0.jar
+lib/elasticsearch/lib/lucene-core-6.3.0.jar
+lib/elasticsearch/lib/lucene-grouping-6.3.0.jar
+lib/elasticsearch/lib/lucene-highlighter-6.3.0.jar
+lib/elasticsearch/lib/lucene-join-6.3.0.jar
+lib/elasticsearch/lib/lucene-memory-6.3.0.jar
+lib/elasticsearch/lib/lucene-misc-6.3.0.jar
+lib/elasticsearch/lib/lucene-queries-6.3.0.jar
+lib/elasticsearch/lib/lucene-queryparser-6.3.0.jar
+lib/elasticsearch/lib/lucene-sandbox-6.3.0.jar
+lib/elasticsearch/lib/lucene-spatial-6.3.0.jar
+lib/elasticsearch/lib/lucene-spatial-extras-6.3.0.jar
+lib/elasticsearch/lib/lucene-spatial3d-6.3.0.jar
+lib/elasticsearch/lib/lucene-suggest-6.3.0.jar
 lib/elasticsearch/lib/securesm-1.1.jar
 lib/elasticsearch/lib/snakeyaml-1.15.jar
 lib/elasticsearch/lib/spatial4j-0.6.jar
@@ -47,7 +46,7 @@
 lib/elasticsearch/modules/lang-expression/asm-commons-5.0.4.jar
 lib/elasticsearch/modules/lang-expression/asm-tree-5.0.4.jar
 lib/elasticsearch/modules/lang-expression/lang-expression-${PKGVERSION}.jar
-lib/elasticsearch/modules/lang-expression/lucene-expressions-6.2.0.jar
+lib/elasticsearch/modules/lang-expression/lucene-expressions-6.3.0.jar
 lib/elasticsearch/modules/lang-expression/plugin-descriptor.properties
 lib/elasticsearch/modules/lang-expression/plugin-security.policy
 lib/elasticsearch/modules/lang-groovy/groovy-2.4.6-indy.jar
@@ -78,13 +77,13 @@
 lib/elasticsearch/modules/transport-netty3/plugin-descriptor.properties
 lib/elasticsearch/modules/transport-netty3/plugin-security.policy
 lib/elasticsearch/modules/transport-netty3/transport-netty3-${PKGVERSION}.jar
-lib/elasticsearch/modules/transport-netty4/netty-buffer-4.1.5.Final.jar
-lib/elasticsearch/modules/transport-netty4/netty-codec-4.1.5.Final.jar
-lib/elasticsearch/modules/transport-netty4/netty-codec-http-4.1.5.Final.jar
-lib/elasticsearch/modules/transport-netty4/netty-common-4.1.5.Final.jar
-lib/elasticsearch/modules/transport-netty4/netty-handler-4.1.5.Final.jar
-lib/elasticsearch/modules/transport-netty4/netty-resolver-4.1.5.Final.jar
-lib/elasticsearch/modules/transport-netty4/netty-transport-4.1.5.Final.jar
+lib/elasticsearch/modules/transport-netty4/netty-buffer-4.1.6.Final.jar
+lib/elasticsearch/modules/transport-netty4/netty-codec-4.1.6.Final.jar
+lib/elasticsearch/modules/transport-netty4/netty-codec-http-4.1.6.Final.jar
+lib/elasticsearch/modules/transport-netty4/netty-common-4.1.6.Final.jar
+lib/elasticsearch/modules/transport-netty4/netty-handler-4.1.6.Final.jar
+lib/elasticsearch/modules/transport-netty4/netty-resolver-4.1.6.Final.jar
+lib/elasticsearch/modules/transport-netty4/netty-transport-4.1.6.Final.jar
 lib/elasticsearch/modules/transport-netty4/plugin-descriptor.properties
 lib/elasticsearch/modules/transport-netty4/plugin-security.policy
 lib/elasticsearch/modules/transport-netty4/transport-netty4-${PKGVERSION}.jar
diff -r e176baaaeae5 -r 3d00747fb171 databases/elasticsearch/distinfo
--- a/databases/elasticsearch/distinfo  Tue Jan 03 08:54:17 2017 +0000
+++ b/databases/elasticsearch/distinfo  Tue Jan 03 09:05:33 2017 +0000
@@ -1,9 +1,9 @@
-$NetBSD: distinfo,v 1.22 2016/12/05 10:51:03 fhajny Exp $
+$NetBSD: distinfo,v 1.23 2017/01/03 09:05:33 fhajny Exp $
 
-SHA1 (elasticsearch-5.0.2.tar.gz) = 88f4f6eebdc902d577a558b0ffd775b2b4a9d552
-RMD160 (elasticsearch-5.0.2.tar.gz) = 52198bdd2d96950eb5c97a586a7b30248ac4557f
-SHA512 (elasticsearch-5.0.2.tar.gz) = be7d89dc1c85cdab19ed5c8e53b337f3e6505e989448cd1cf32fa4cd4e125cf425aaf9b1ee85d4029715e5c01bc6aee226fbaf8c335f267c13599049818bcf27
-Size (elasticsearch-5.0.2.tar.gz) = 32951077 bytes
+SHA1 (elasticsearch-5.1.1.tar.gz) = 7351cd29ac9c20592d94bde950f513b5c5bb44d3
+RMD160 (elasticsearch-5.1.1.tar.gz) = 302166ebfd85a1176ebbf5aa9883d9fb83488b40
+SHA512 (elasticsearch-5.1.1.tar.gz) = 2b5faf97c5ff41a9f12e21749d60f3632b39987d4886713ee9646110acdd17323d263168980d7dd4035732556b604acd68dc37ae7b805d84493075776b9d7bcd
+Size (elasticsearch-5.1.1.tar.gz) = 33291322 bytes
 SHA1 (patch-bin_elasticsearch) = 5360818fb870c0005e23f0fb247efa247a909f47
 SHA1 (patch-bin_elasticsearch-plugin) = 56db071765b91a4846e1529b5fe8be2c549b449d
 SHA1 (patch-config_elasticsearch.yml) = 8a59f9123b8bc1c40d17131dc51c361fa210c17c



Home | Main Index | Thread Index | Old Index