Commit Graph

40 Commits

Author SHA1 Message Date
shashank khare
df04b27e22 Fix #104: memory leak in poll_batch (#107)
poll_batch currently leaks memory while initialising the queue
returned by rd_kafka_queue_get_consumer. The fix as suggested
by @mfontanini as done here is to initialise the queue with a
Queue so it's cleaned up when going out of scope.
2018-07-26 08:56:42 -07:00
Alex Damian
d6f8129207 Fix for ref count on queue handles (#92)
* Fix for ref count on queue handles

* added check for rdkafka version

* changed to runtime version checking
2018-07-23 17:07:35 -07:00
Alex Damian
577bbb0242 added error check for partition list (#90) 2018-06-26 08:57:49 -07:00
Alex Damian
c5aca985b8 Invoke error callback if present instead of log callback (#93) 2018-06-20 09:11:24 -07:00
Alex Damian
9714bec5bf Callback invoker to sink all thrown exceptions (#74) 2018-06-01 16:35:56 -07:00
accelerated
169ea4f8ed Fixes to queue polling and making them non-owning 2018-05-29 09:55:30 -04:00
accelerated
532d83b225 Removed reserve() and synced consumer::poll_batch and queue::poll_batch functions 2018-05-29 09:55:30 -04:00
accelerated
a1ce130bfd changes as per code review 2018-05-29 09:55:29 -04:00
accelerated
15be627f8e intial polling version 2018-05-29 09:55:29 -04:00
Alex Damian
46c396f729 Pause/resume a consumer by topic (#67)
* Pause a consumer by topic

* Changes per review comments

* convert rvalue to value

* Refactored code to provide a more generic way of getting partition subsets

* Changes per code review and added test cases

* Modified loop to use binary search instead of linear

* Simplify find_matches test cases
2018-05-23 13:03:47 -07:00
Alex Damian
ae74814791 Log error in case consumer destructor throws (#61) 2018-04-27 07:03:47 -07:00
Alex Damian
83a963c1db Added commit for current assignment and message state checks (#53) 2018-04-20 23:51:44 +01:00
Matias Fontanini
69e30f9e74 Merge pull request #39 from arvidn/destruction
destruct callbacks (and their closures)
2018-03-17 15:42:21 -07:00
arvidn
98b9839ff9 improve performance of Consumer::poll_batch() by allocating the results array once, rather than incremental growth. Also avoid checking every single pointer in the returned array, just use the returned counter instead 2018-02-08 12:22:11 +01:00
arvidn
d173526f99 destruct callbacks (and their closures) to ensure there are no reference cycles when destructing the consumer. This solves a hang in rd_kafka_destroy 2018-02-08 11:51:36 +01:00
Matias Fontanini
4c9aa6fcd4 Catch exceptions on Consumer destructor
Fixes #6
2017-09-14 19:26:38 -07:00
Matias Fontanini
37cb16c3f5 Check for null pointer on Consumer::poll_batch
Fixes #8
2017-09-06 23:44:34 -07:00
Matias Fontanini
1582f6156d Allow consuming message batches
Fixes #3
2017-07-17 19:17:57 -07:00
Matias Fontanini
2f9170e32a Fix build errors/warnings on Windows 2017-06-03 12:23:06 -07:00
Matias Fontanini
9594ddced3 Update license 2017-05-06 08:27:47 -07:00
Matias Fontanini
a46896790b Allow polling with a timeout 2016-10-08 10:08:15 -07:00
Matias Fontanini
c3d6ce99f5 Make Consumer::close private 2016-07-16 08:45:33 -07:00
Matias Fontanini
a2e7f6db0d Add getters for Consumer callbacks 2016-06-25 08:42:04 -07:00
Matias Fontanini
9751acd8df Add some documentation 2016-06-12 17:49:11 -07:00
Matias Fontanini
eed3ac270a Add license and README file 2016-06-05 18:19:23 -07:00
Matias Fontanini
7708e945b7 Add get/query offset wrappers 2016-06-05 18:14:46 -07:00
Matias Fontanini
8e37440f58 Add config callbacks 2016-06-04 18:16:21 -07:00
Matias Fontanini
82393b558e Add offset commit and delivery report callbacks 2016-05-31 07:26:31 -07:00
Matias Fontanini
fd2d616506 Add some consumer tests 2016-05-29 20:23:56 -07:00
Matias Fontanini
5b957de7e4 Replace TopicPartitionList class with a vector of TopicPartition 2016-05-28 09:02:44 -07:00
Matias Fontanini
c31d00115a Add metadata objects and tests for them 2016-05-26 20:45:12 -07:00
Matias Fontanini
4475209ce1 Add first producer test 2016-05-22 19:47:23 -07:00
Matias Fontanini
29989ea346 Add consumer rebalance callbacks 2016-05-22 15:11:32 -07:00
Matias Fontanini
58258750df Add pause/resume partitions wrappers 2016-05-22 09:52:42 -07:00
Matias Fontanini
83c1d304c6 Add more wrappers for Consumer 2016-05-22 09:49:39 -07:00
Matias Fontanini
c491136e0e Add committed/assigned wrappers 2016-05-21 20:39:37 -07:00
Matias Fontanini
acd5c4a603 Add commit overloads for TopicPartitionList 2016-05-21 20:20:52 -07:00
Matias Fontanini
5606b81ecb Add commit methods to Consumer 2016-05-21 20:16:08 -07:00
Matias Fontanini
1c51bb72f4 Add Consumer::poll 2016-05-21 19:51:50 -07:00
Matias Fontanini
4f50122393 Add initial consumer code 2016-05-21 19:31:24 -07:00