I had 2 cylinders repaired due to out of limits valve wobble tests and one of the repaired cylinders just about always lagged the other 3 on cold starting. Its EGT lagged the others by about 20 seconds and the engine ran rough until its EGT substantially caught up to the others. One theory was that one or both of that cylinder's lifters were collapsing and taking some time to resume operation and properly open the valves. The lifters were fine. Eventually my local shop sent the cylinder back to the repair shop to be reworked. They sent the reworked cylinder back with another set of rings and it has been fine since.
I was not at the shop when the lifter work was done, so its possible that the lifters were not removed if the hydraulic units can be examined and tested without removing the lifter.
I am also ready to be corrected, but for now I still think that they can be removed. See this Lycoming Service Bulletin, and specifically the paragraph under the first "WARNING". It talks about things that must be done if the roller lifters are removed prior to overhaul. I take this to mean that removal is possible without splitting the case.
https://www.lycoming.com/sites/default/files/SI1514C Roller Tappet Part Info Update_0.pdf
And if you compare roller lifters to Lycoming old standard lifters, the diameter of the roller appears to be no larger than the diameter of the body so it makes sense that it could be extracted from the case (as Continental lifters can). OTOH, old standard Lycoming lifters have a wide face that is too large to fit through the cavity in which the lifter body slides. See this web page near the bottom for a comparison:
https://www.lycoming.com/parts/tappets#section_2