The incident was recorded at around 3 p.m. on Tuesday and Juraitis broadcast his actions on his Facebook account, Julija Samorokovskaja, spokeswoman for Vilnius police, told BNS, adding that his actions are being treated as a possible violation of public order.
"We are collecting information under Article 284 of the Criminal Code, i.e. a violation of public order. A pre-trial investigation has not yet been launched and the information is still being collected," the police representative said.
Grinda, a municipal enterprise, later covered the sculptures again, she said.
Juraitis, who travelled to meet with the Belarusian authorities earlier this year, is part of an ongoing investigation into the activities of the International Forum for Good Neighborhood that was set up by Paleckis.
As part of this case, several people are suspected by law enforcement of helping aiding another country to act against Lithuania. Juraitis earlier confirmed he had been questioned by police as part of this probe.
Vilnius politicians made the decision earlier this year to remove the six grey granite statues of Soviet WWII soldiers and hand them over to the National Museum of Lithuania.