As a developer, I want to be able to measure the memory consumptions of the state, so that it is easier to spot what to optimize

[tizoc]

Task is to implement functions to measure the memory consumption of the different parts of the state that we use in the state machine.

This crate seems useful:

https://docs.rs/graphannis-malloc_size_of/latest/graphannis_malloc_size_of/
https://docs.rs/graphannis-malloc_size_of_derive/latest/graphannis_malloc_size_of_derive/

At the top of each crate this is needed so that the macro works:

extern crate graphannis_malloc_size_of as malloc_size_of;
extern crate graphannis_malloc_size_of_derive as malloc_size_of_derive;

And in Cargo.toml:

[dependencies]
graphannis-malloc_size_of = "2.0.0"
graphannis-malloc_size_of_derive = "2.0.0"

Not everything needs to be measured (P2pConfig for example is not important to measure), but anything with a dynamic size (networking and peer state in the p2p crate for example, the snark pool state, transaction pool state, transition frontier state, etc)

[vlad9486]

Status: Implementing for p2p state. Left few todo marks.

[vlad9486]

Implemented RPC access to the memory consumption.
Measure Kad consumption.
Fixed the underlying crate for modern Rust allocator.

[vlad9486]

Working on mina-p2p-messages support to measure block, snark and tx allocated size.

[vlad9486]

Implemented measurement for "mina-p2p-messages".
Measure Arc correctly.
Complete p2p state measurement.
Fixed bugs.

[vlad9486]

Measure resources usage by transition frontier and snark pool. Improve report representation.