Commit Graph

427 Commits

Author SHA1 Message Date
Matias Fontanini
dd3966fb45 Merge pull request #281 from ClickHouse-Extras/fix_failover
Fix for failover issue.
2021-06-02 16:04:02 -07:00
Mikhail Filimonov
dabb2d3aa8 Fix for failover issue.
When the consumer enters the group and gets no assignment (for ex. there is not enough partitions in the topic),
librdkafka waits for the rebalancing sequence to be finished by calling assign with the empty list of partitions
(just as was passed by librdkafka to rebalance callback).

But cppkafka instead pass nullptr instead of an empty list (which means unassign). And consumer stuck forever in that
state, not being able to pick the partition during the next rebalance (failover), because the previous rebalance sequence
was not finished.

Fixes https://github.com/mfontanini/cppkafka/issues/273 , https://github.com/ClickHouse/ClickHouse/issues/21118 , etc.
2021-06-01 23:36:25 +02:00
Matias Fontanini
57a599d99c Merge pull request #277 from oxidecomputer/master
Adds support for building on Solaris-based systems
2021-05-02 14:30:37 -07:00
Benjamin Naecker
544972e48f Adds support for building on Solaris-based systems 2021-04-28 14:13:56 -07:00
Matias Fontanini
847f530e6e Merge pull request #227 from neatlife/fix-macos-rt
remove rt lib if mac os
2021-04-28 08:26:25 -07:00
Matias Fontanini
01bd066d57 Merge pull request #267 from jlcordeiro/feature/boost_cleanup
remove unused boost includes
2021-04-16 09:22:36 -07:00
Matias Fontanini
8fd0ef8fc5 Merge pull request #272 from psigen/bugfix_readonly
Add fix for in-source build of cppkafka.h.
2021-04-03 09:14:34 -07:00
Pras Velagapudi
85f1c0fcb1 Add fix for in-source build of cppkafka.h.
This fixes an issue where a cppkafka.h is being generated directly
within the source directory, which causes issues on sandboxed build
environments where the source directory is mounted readonly.

This PR changes the configure_file() directive to point to the
binary directory, and uses the install directives to move the
generated file into the build output.
2021-03-04 03:47:32 -05:00
Joao Cordeiro
62ec1d82c1 remove unused boost includes 2020-10-18 12:30:27 +01:00
Matias Fontanini
5e4b350806 Merge pull request #265 from accelerated/find-package
Fix CMAKE warning
2020-09-05 09:45:20 -07:00
Alexander Damian
e932d9567f Fix CMAKE warning 2020-09-04 18:20:38 -04:00
Matias Fontanini
a2056c36bf Merge pull request #263 from accelerated/sync-produce
Call flush termination callbacks from sync_produce
2020-08-31 19:59:37 -07:00
Alexander Damian
8cfd4595f6 Call flush termination callbacks from sync_produce 2020-08-31 21:56:10 -04:00
Matias Fontanini
f117720f66 Merge pull request #248 from filimonov/patch-1
Try to fix travis
2020-08-31 18:46:44 -07:00
Matias Fontanini
e5dfd5085c Merge pull request #261 from hanickadot/master
Ability to block producer in case the underlying queue is full.
2020-08-15 18:03:15 -07:00
Hana Dusíková
a032f9a1e8 Ability to block producer in case the underlying queue is full. 2020-08-14 19:29:55 +02:00
Matias Fontanini
b06e64ef5b Merge pull request #257 from accelerated/resume-scope
Bring base class  resume into scope
2020-07-19 11:23:53 -07:00
Alexander Damian
a48bf89292 Bring base class into scope 2020-07-19 12:40:52 -04:00
filimonov
31a58d433e Update .travis.yml 2020-05-24 19:54:11 +02:00
filimonov
4467743340 Update .travis.yml 2020-05-24 19:43:30 +02:00
filimonov
e8b4f5a8e9 Update .travis.yml 2020-05-24 19:29:06 +02:00
filimonov
eb1105d839 Update .travis.yml 2020-05-24 17:32:35 +02:00
filimonov
098735413b Update .travis.yml 2020-05-24 15:47:53 +02:00
filimonov
91a3be0a8f Update .travis.yml 2020-05-24 10:52:15 +02:00
Matias Fontanini
e2000b0741 Merge pull request #246 from LesnyRumcajs/patch-2
fixed typo in example (log message)
2020-05-23 09:34:41 -07:00
Matias Fontanini
ca3a1321ec Merge pull request #247 from filimonov/kafka_destroy_flags3
Add support for rd_kafka_destroy_flags.
2020-05-23 09:24:38 -07:00
Mikhail Filimonov
244726c251 Style changes 2020-05-22 17:24:19 +02:00
filimonov
7aa60a1409 Add latest rdkafka version to build matrix 2020-05-22 00:16:12 +02:00
filimonov
487585fd17 Try to fix travis
Old URL returns 404, picked new from official webpage: https://kafka.apache.org/downloads
2020-05-22 00:10:49 +02:00
Mikhail Filimonov
3b67ba072a Add support for rd_kafka_destroy_flags. 2020-05-21 23:38:17 +02:00
LesnyRumcajs
14423bba40 fixed typo log message 2020-05-12 10:49:08 +02:00
Matias Fontanini
006642cdb2 Merge pull request #237 from accelerated/buff_prod_comments
Added clarifications and comments to the BufferedProducer class
2020-04-18 10:56:51 -07:00
Matias Fontanini
679f58dee3 Merge pull request #241 from accelerated/timeout-overloads
Added timeout overloads for consumer and handle classes
2020-04-08 08:28:26 -07:00
Docker RHEL
b2b0d16fee Added timeout overloads for consumer and handle classes 2020-04-08 15:23:05 +00:00
Matias Fontanini
2ce0ae4a62 Merge pull request #238 from accelerated/poll_strategy
Added member functions for static consumers
2020-04-08 07:14:58 -07:00
Alexander Damian
935a34238b Added implementation for thread-aware ack monitoring 2020-03-05 14:56:36 -05:00
Alexander Damian
5a057e4c99 Wait until the ack is received without timing out.
wait_for_acks() should default to infinite timeout since the
original implementation was never timing out.
2020-02-16 21:06:14 -05:00
Alexander Damian
ffcf8956bd Allow to pass-in via cmake all the kafka config options for testing: broker, partitions and topics 2020-02-16 20:11:33 -05:00
Alexander Damian
2287e0994b Express async_flush in terms of flush since the logic is identical except for the timeout 2020-02-16 20:11:33 -05:00
Alexander Damian
92e46aa6cb Proper implementation of flush() with timeout 2020-02-16 20:11:20 -05:00
Alexander Damian
a4532ed336 Use erase directly
Added revoke() member function
2020-02-09 21:25:36 -05:00
Alexander Damian
68ae525eba Added member functions for static consumers 2020-02-08 22:34:45 -05:00
Alexander Damian
e401e97b40 Added clarifications and comments to the BufferedProducer class 2020-02-08 21:24:12 -05:00
Matias Fontanini
7d097df34d Merge pull request #235 from accelerated/promise_bug
Fix tracker promise from throwing when set multiple times
2020-02-04 06:23:39 -08:00
Alexander Damian
fbbd5bc5a6 Changed int to size_t 2020-02-03 22:04:50 -05:00
Alexander Damian
bda2f4156d Fix tracker promise from throwing when set multiple times 2020-02-03 16:46:28 -05:00
Matias Fontanini
f1de729d4e Merge pull request #234 from accelerated/null_topic
Fix crash when message handle is valid but topic is null
2020-01-27 09:09:44 -08:00
Alexander Damian
81ce56a1bd Fix case when message handle is valid but topic is null 2020-01-27 10:30:12 -05:00
suxiaolin
a2a46f0ec8 remove rt lib if mac os 2019-11-03 16:12:57 +08:00
Matias Fontanini
c3b4580fef Merge pull request #210 from ych/pc_config
Remove boost dependency from pkg-config template file
2019-09-05 09:39:52 -07:00