The rogue has a t3 ability that allows him to use his cloak even when it is unequipped, at the cost of a slower recharge time. Fully upgraded this reduces the charge speed of the cloak by only 25%, and otherwise the cloak maintains full functionality. What you are asking for is literally in the game, you just need to beat tengu.
Rom builds can be so op sometimes with warrior, since you have abilities that scale with strength