Bill Cosby’s lawyers said Tuesday they will ask a federal judge to throw out a defamation lawsuit filed by three women accusing him of decades-old sexual offenses.

The lawyers said in a legal brief they plan to file their motion to dismiss by Friday.

One of the women, Tamara Green, a California lawyer who says Cosby drugged and sexually assaulted her in the 1970s, originally brought the lawsuit in December 2014. Two women from Florida later joined the suit: Therese Serignese says Cosby drugged and raped her in 1976, and Linda Traitz alleges he tried to drug her and then sexually groped her in 1970.

The women argue that Cosby publicly branded them as liars through statements by his representatives. They seek an unspecified amount of money for compensatory and punitive damages.

Their lawyers have said the civil action also allows them to have their allegations heard since criminal statutes of limitation have expired. Cosby has denied wrongdoing and hasn’t been charged with any crime.