Real-Time Hashtag Partitioning

You work as a data engineer in X (formerly Twitter), in a team responsible for building the platform’s trending chart for monitoring global social media trends. The system ingests a high-volume stream of tweets, and your team needs to partition incoming tweets into buckets based on hashtags as they arrive.

How would you architect the data pipeline and select data structures to efficiently partition and store tweets by hashtag in real time?