database rewrite - meta + timeline

[zelig]

Storage refactor

part I: DB refactor

part II is: #1039

Phase 0 - prerequisites

• shed - field and index abstractions - DB Store Abstractions #993, swarm: add database abstractions (shed package) ethereum/go-ethereum#18183
• rushed
  • multi mode accessors - [WIP] rushed - shed extension  #1006
  • batch acceleration (if...?) see
  • iterators, subscription, continuous feeds[WIP] Shed subscription #1014

Phase 1 - functionality

• localstore package - merged as swarm/storage/localstore: new localstore package ethereum/go-ethereum#19015
  • dbstore using shed - Implement DB store API #990 , swarm/network, swarm/pss, p2p/simulations: adapt test kademlia params #1022
  • define and test accessor modes
  • integrate mock global-store - Mock chunk sending for more robust simulations #992
• iterators and subscriptions
  • garbage collection - localstore/db how to insert items in GC index #1031
  • push sync: syncer - db interface - db subscribe to push index as part of syncer #1030
  • pull sync: streamer - db interface

Context: Garbage Collection and Syncing and Proof of Burn - #1017

Phase 2 - integration

• localstore integration - Storage package reorganisation #1257 Localstore integration #1282
  • migrate old db to new cmd/swarm: new localstore database migration #1297
  • netstore
  • hasherstore
  • network package
  • syncing simulation
  • syncing simulation with mock globalstore
  • push syncer

---

Phase 3 - optimisation

• benchmarks
  • chunk, shed, storage: chunk.Store GetMulti method #1691
  • chunk, storage: chunk.Store multiple chunk Put #1681
  • chunk, storage: storage with multi chunk Set method #1684
  • chunk, storage: add HasMulti to chunk.Store #1686

[zelig]

@janos great job, I consider this done :)