The fix finally clicked by using those dowels. After that problem was solved, it was all down hill.