🎉Community Raffle - Win $25

An exclusive raffle opportunity for active members like you! Complete your profile, answer questions and get your first accepted badge to enter the raffle.

Join and Win

Secure Website Certificate Expired - How to workaround?

Thomas_Ott

This is an interesting problem and was wondering if the Community has come across this situation and how the solved it.

I'm scraping a website that has a URL beginning with https://. It worked just fine until today when the website's security certificate expired. Now the scraping returns no results. If I changed the URL to http://, then I get 301 Moved Permanently responses. This might all clear up in a day or two if the website renews their certificate, but for my knowledge (and the Community's), is there a work around this problem?

I can't share the XML but @sgenzer can probably guess what this is related too.

Find more posts tagged with

AI Studio

Accepted answers

BalazsBaranyRM

Hi!

Resetting your computer's clock by a few days might work if it's only the client that checks the certificate validity.

Regards,

Balázs

All comments

sgenzer

yeah I have a hunch what you're referring to Unfortunately I don't have any ideas at the moment...

Scott

BalazsBaranyRM

Hi!

Resetting your computer's clock by a few days might work if it's only the client that checks the certificate validity.

Regards,

Balázs

Thomas_Ott

Thanks @BalazsBarany, I will try that as I expect this to resolve itself in a few days.

@sgenzer I think I know what you are referring to what I referred to!

Thomas_Ott

Yep, that worked @BalazsBarany! Fingers crossed that the certificate gets renewed in the next couple of days.

Telcontar120

The clock trick is pretty clever. I have had this problem myself in the past and I had never figured out a solution. As you said, most responsible domain owners will eventually update their certificates...