saingchildren/GeoPulse_Pipeline
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

fix: 解決kafka會遺漏commit已處理的meesage的問題

Browse Source
This commit is contained in:
saingchildren 2026-04-30 10:09:12 +08:00
parent 33638bdd36
commit 33606ca9eb
1 changed files with 3 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
GeoPulse Pipeline/KafkaConsumer.cs
View File

@ -64,8 +64,9 @@ public class KafkaConsumer : BackgroundService
await BulkInsertToDatabaseAsync(buffer, stoppingToken); await BulkInsertToDatabaseAsync(buffer, stoppingToken);
var latestOffset = buffer.Last(); var offsets = buffer.GroupBy(msg => msg.TopicPartition)
consumer.Commit(latestOffset); .Select(g => new TopicPartitionOffset(g.Key, g.Last().Offset + 1)).ToList();
consumer.Commit(offsets);
_logger.LogInformation($"✅ [成功] 已寫入 {buffer.Count} 筆資料至 PostgreSQL。"); _logger.LogInformation($"✅ [成功] 已寫入 {buffer.Count} 筆資料至 PostgreSQL。");