Grid[{
{1, SpanFromLeft, "A"},
{3, SpanFromLeft, SpanFromAbove},
{4, 5, "B"},
{6, 7, 8}
}, Frame -> All]
Is this closer to what you're looking for? I couldn't figure out how to remove the frame line however between "A" and "B". I don't know why the rows have different vertical span in your implementation
{1, SpanFromLeft, "A"},
{3, SpanFromLeft, SpanFromAbove},
{4, 5, "B"},
{6, 7, 8}
}, Frame -> All]
Is this closer to what you're looking for? I couldn't figure out how to remove the frame line however between "A" and "B". I don't know why the rows have different vertical span in your implementation