Finally figured out how to drastically reduce the poly count without distorting the textures, baking a "flawless" normal map with this specific mesh was just too much work though. Works fine in UE4 but Blender has some problems with UV seams. I'd recommend tiling a detail normal map on top for some extra added detail.