The Scout aggregator was conceived as an initial solution to the problem of counting and statistics of events in reasonable times to display in the web application.
The idea behind the aggregator is to precompute counts that are relevant to event reporting in order to lighten the burden on reporting services. Based on this idea, the following architecture was determined for the solution:
The aggregation process consists of extracting data from the main repository in redshift from time to time according to its creation date in the database, in parallel a record is kept of what was the last creation date that was registered in the database to be able to resume aggregation at each cycle.