Storage planning

Device data estimator

Estimate the raw data generated by your fleet across common retention periods.

Total planned storage

One day of maximum raw storage plus 365 days of final JSONL.gz and MongoDB physical storage.

Raw peak, 1 day-

Raw data, 365 days-

Timeseries data, 365 days-

Infrastructure note: for 100 devices, plan a minimum of 4 CPU cores and 8 GB RAM.

Your fleet

Enter the number of devices and how frequently each device sends data.

Device count active devices

Device send interval (seconds) seconds between data points for each device

Packets per interval data packets sent by each device in one interval

Each incoming packet is stored as one 1.2 KB raw JSON file. Final storage uses the supplied 15-minute JSONL sample's measured 1.962% gzip ratio: 86,400 packets compress to 1.86 MB per device/day.

Raw storage before processing

Raw JSON files created each day -

Maximum one-day raw storage-

Raw formula: devices x (86,400 / send interval in seconds) x packets per interval x 1.2 KB. Raw files are removed after successful daily processing.

Final processed output

Final JSONL.gz files created each day One daily file is created for each device.

Final size - 1 day-

Final size - 7 days-

Final size - 30 days-

Final size - 365 days-

Final estimate: devices x (packets per interval / send interval in seconds) x 1.86 MB per device/day. The supplied 1.10 MB JSONL contains 1,005 records over 15 minutes; its measured gzip ratio is applied to a 86,400-packet day.

MongoDB time-series storage

MongoDB documents created each day Observed collection: 716 B logical BSON per document, about 157 B on disk including 5 indexes.

Logical BSON - 1 day-

Physical disk - 1 day-

Physical disk - 30 days-

Physical disk - 365 days-

MongoDB physical estimate includes the observed time-series compression and five index sizes: (293.56 MB data + 176.84 MB indexes) / 3 million documents = approximately 157 B per document.