raft: revamp async log storage protocol

[pav-kv]

The async log storage protocol (etcd-io/raft#8) can be improved in a few aspects:

• The ABA problem prevention can be achieved by a more straightforward algorithm when we have the "last accepted term" tracking [raft: advance commit index safely #122690].
• The need for preventing the ABA problem can be eliminated in the first place, if we delegate the unstable log to storage engine synchronously, and only assume flush/fsync is asynchronous [raft: clean unstable log early #122438].
• We can remove various fields of raftpb.Message used only by this local protocol, to unclutter Message and make it smaller.

---

To support the new log write protocol, we are missing the notion of "leader term" - the term of the leader with whom our log is consistent. By raft invariants, all writes to, and acknowledgements from log storage are ordered by (leader term, index). Today, we approximate the "leader term" by using the last entry ID, but it complicates the protocol. It is also hard to reuse for Replication Admission Control because it requires remembering the unacknowledged entry IDs, but these are cleared from the unstable data structure as soon as the entries are written.

The plan is to support the "leader term" tracking:

• track the "leader term" / "last accepted term": raft: advance commit index safely #122690
• move the tracking to raftLog/unstable structures
  • raft: pass logSlice from maybeAppend to append #126474
  • raft: introduce logMark and snapshot type #126475
  • raft: make unstable a logSlice #126783
• convert MsgStorageAppend[Resp] messages to use the leader term
  • raft: use last accepted term for log writes #127424
• optional: implement the fork tracking data structure to allow earlier acks when the leader term changes
• convert MsgStorageAppend[Resp] messages protocol to a type-safe/ergonomic Ready/Response API.
  • raft: replace MsgStorageAppend protocol #143705

---

Epic: CRDB-37515, CRDB-46488
Jira issue: CRDB-38897

[blathers-crl]

cc @cockroachdb/replication