Rex Polypaint

I'm having a bit of trouble with polypaint, I painted a base layer but now nothing seems to paint on top of it.

Start of Trex Texture

Carlton Texture in engine

Diffuse Map

 Roughness Map

Carlton Poly Paint

Here is Carlton as he currently looks PolyPainted. I think it will look much better if I can get him into Substance personally.