Abstract:In the Internet of Things (IoT) era, the surge in Machine-Type Devices (MTDs) has introduced Massive IoT (MIoT), opening new horizons in the world of connected devices. However, such proliferation presents challenges, especially in storing and analyzing massive, heterogeneous data streams in real time. In order to manage Massive IoT data streams, we utilize analytical database software such as Apache Druid version 28.0.0 that excels in real-time data processing. Our approach relies on a publish/subscribe mechanism, where device-generated data are relayed to a dedicated broker, effectively functioning as a separate server. This broker enables any application to subscribe to the dataset, promoting a dynamic and responsive data ecosystem. At the core of our data transmission infrastructure lies Apache Kafka version 3.6.1, renowned for its exceptional data flow management performance. Kafka efficiently bridges the gap between MIoT sensors and brokers, enabling parallel clusters of brokers that lead to more scalability. In our pursuit of uninterrupted connectivity, we incorporate a fail-safe mechanism with two Software-Defined Radios (SDR) called Nutaq PicoLTE Release 1.5 within our model. This strategic redundancy enhances data transmission availability, safeguarding against connectivity disruptions. Furthermore, to enhance the data repository security, we utilize blockchain technology, specifically Hyperledger Fabric, known for its high-performance attributes, ensuring data integrity, immutability, and security. Our latency results demonstrate that our platform effectively reduces latency for 100,000 devices, qualifying as an MIoT, to less than 25 milliseconds. Furthermore, our findings on blockchain performance underscore our model as a secure platform, achieving over 800 Transactions Per Second in a dataset comprising 14,000 transactions, thereby demonstrating its high efficiency.

FogMQ: A Message Broker System for Enabling Distributed, Internet-Scale IoT Applications over Heterogeneous Cloud Platforms

Operator Placement for Data Stream Processing Based on Publisher/subscriber in Hybrid Cloud-Fog-edge Infrastructure

TD-MQTT: Transparent Distributed MQTT Brokers for Horizontal IoT Applications

Mobility-Aware Task Offloading and Migration Schemes in Fog Computing Networks.

Improvement of MQTT semantic to minimize data flow in IoT platforms based on distributed brokers

Engineering and Experimentally Benchmarking Open Source MQTT Broker Implementations

Efficient Solution for Large-Scale IoT Applications with Proactive Edge-Cloud Publish/Subscribe Brokers Clustering

On Using Micro-Clouds to Deliver the Fog

DZMQ: A Decentralized Distributed Messaging System for Realtime Web Applications and Services

A Study of Moving from Cloud Computing to Fog Computing

Mobility-Aware Fog Computing in Dynamic Environments: Understandings and Implementation.

Foggy: A Platform for Workload Orchestration in a Fog Computing Environment

Fog-Cloud Based Platform for Utilization of Resources Using Load Balancing Technique

A Survey of Communication Protocols for Internet of Things and Related Challenges of Fog and Cloud Computing Integration

Publish/Subscribe Method for Real-Time Data Processing in Massive IoT Leveraging Blockchain for Secured Storage

Fully Distributed Fog Load Balancing with Multi-Agent Reinforcement Learning

Survey of Communication Protocols for Internet-of-Things and Related Challenges of Fog and Cloud Computing Integration

A Survey of Distributed Message Broker Queues

Efficient Multi-Broker Load Balancing in Event Driven Pub-Sub Networks

Research On Docker-Based Message Platform In Iot

MicroFog: A Framework for Scalable Placement of Microservices-based IoT Applications in Federated Fog Environments