Broken URLs

[teeli]

Please report any URLs that aren't working properly (either causing errors on your bot's partyline or just not showing titles correctly) here.

Make sure you include the URL in question, any errors you might see and your configuration (any relevant software versions, e.g. eggdrop version, tcl version, tcl extension versions)

[OmkAR2013]

eggdrop 1.80
Tcl library: /home/eggie/tcl85/lib/tcl8.5
Tcl version: 8.5.19 (header version 8.5.19)
TLS support is enabled.
TLS library: OpenSSL 1.0.2g 1 Mar 2016

https://twitter.com/Breaking911/status/842624423358291968

[05:09:32] Tcl error [UrlTitle::handler]: can't read "meta(Content-Type)": no such element in array

[teeli]

@OmkAR2013 that should be fixed in the latest version

[OmkAR2013]

I got all previously unworking url's working. It's great! Everything except Twitter https links.

https://twitter.com/Reuters
https://twitter.com/i/moments/842395226299760641

There's no error being displayed in the bot log, so I'm not sure what's happening.
Using newest urltitle.tcl

Any suggestions? What setup do you have teeli for your working bot?

CONFIG ->

I am mOOpeY, running eggdrop v1.8.1+RC2: 1 user (mem: 100k).
Configured with: '--with-tcllib=/home/moopey/local/lib/libtcl8.6.so' '--with tclinc=/home/moopey/local/include/tcl.h' '--enable-tls'
OS: Linux 4.4.0-66-generic
Process ID: 37832 (parent 1)
Tcl library: /home/moopey/local/lib/tcl8.6
Tcl version: 8.6.6 (header version 8.6.6)
Tcl is threaded.
TLS support is enabled.
TLS library: OpenSSL 1.0.2g 1 Mar 2016
IPv6 support is enabled.

tDOM - a XML/DOM/XPath/XSLT implementation for Tcl
(Version 0.8.4)

tcltls-1.7.11.tar.gz
tcllib_1_18.tar.gz
tcl8.6.6-src.tar.gz
eggdrop-1.8.1rc2.tar.gz

[knofte]

We're getting similar with random urls now.

07:57:19 <@knofte> https://casinojakten.se
07:57:21 <@servant> Title: Freespin och Bäst Bonus från de Bästa Casinon!! | casinojakten.se
07:57:27 <@knofte> https://www.sunet.se
07:57:29 <@servant> Title: SUNET | Datakommunikation & infrastruktur för forskning och utbildning
07:57:41 <@knofte> http://www.google.com
07:57:46 <@knofte> https://www.google.com
07:57:50 <@knofte> https://google.com
07:57:56 <@knofte> http://google.com
...

ii libtcl8.6:amd64 8.6.5+dfsg-2 amd64 Tcl (the Tool Command Language) v8.6 - run-time library files
ii tcl 8.6.0+9 amd64 Tool Command Language (default version) - shell
ii tcl-dev:amd64 8.6.0+9 amd64 Tool Command Language (default version) - development files
ii tcl-tls 1.6.7+dfsg-1 amd64 TLS OpenSSL extension to Tcl
ii tcl8.6 8.6.5+dfsg-2 amd64 Tcl (the Tool Command Language) v8.6 - shell
ii tcl8.6-dev:amd64 8.6.5+dfsg-2 amd64 Tcl (the Tool Command Language) v8.6 - development files
ii tcl8.6-tdbc 1.0.3-1 amd64 Tcl Database Connectivity
ii tcl8.6-tdbc-sqlite3 1.0.3-1 all Tcl Database Connectivity
ii tcllib 1.17-dfsg-1 all Standard Tcl Library

[FevLoad]

is it fixed yet ?

[teeli]

Should be better support for HTTP(S) redirects and case insensitive HTTP headers now. Google, Twitter etc. should work.

[voidzero]

Hi @teeli,

I have a new issue: with this url:
http://blog.dilbert.com/post/164297628606/how-to-know-youre-in-a-mass-hysteria-bubble

On the partyline, I see this:

Tcl error [UrlTitle::handler]: invalid command name ""

So I added putlog statements everywhere, and it seems to be this line being the culprit:

urltitle/urltitle.tcl

Line 183 in 34582be

set title [[$root selectNodes {//head/title/text()}] data]

Any idea?

[knofte]

I get the same on that url.
Tcl error [UrlTitle::handler]: invalid command name ""

[teeli]

Apparently XPath fails to parse title on that page. I'm not sure why, I suspect it could be because of invalid html structure (stray doctype).

I should probably add some error checking and maybe a regex fallback (if that helps, need to test)

[teeli]

Updated a new version that should fix that issue

[voidzero]

Fixed indeed. Well done. Your TCL-fu is admirable.

[lollko]

after updating imdb there is a problem with urltile

21:37:09 <~lollko> https://www.imdb.com/title/tt1025100/
21:37:11 <&rss> Title: TryIMDbProFree

is it possible to fix ?

[teeli]

Looks like there's an inline SVG element on the page that has a <title> tag. Need to look if it's possible to exclude those.

For reference

...
<svg width="175px" height="30px" viewBox="0 0 172 29" version="1.1" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink">
<title>TryIMDbProFree</title>
<g id="tryIMDbProFree" stroke="none" stroke-width="1" fill="none" fill-rule="evenodd">
<rect id="tryIMDbProFreeButton" stroke="#A88734" fill="#F1C241" x="1" y="1" width="170" height="28" rx="3"></rect>
<text id="tryIMDbProFreeText">
<tspan x="33" y="19">Try IMDbPro Free</tspan>
...