humungus - miniwebproxy

another day, another lazy loader

no comments

save this so we don't lose it

better filters

almost in place

get it going

start reworking to use yaegi

just hostname here, minus port, should make things easier to work with

rework filtering to provide some more features. try to document some of it even.

simply close code a bit

update permitted tags

go.mod build

filter to chew on toots as well

the main tag may be just the tag we're searching for

allow id attribute, so #urls work

repair accidental commit to filter.lua

connect to port 80 is not tls. also add back a bit of logging.

Added tag v0.9.9 for changeset c9662fb3d18c

attempt to deal with websockets. maybe it works.

forgot, easier to just peek than read/unread

use a semi custom transport for roundtrip

simply code a bit. notably, http.transport does a better job handling
idle connections. this seems faster and more reliable.

keepalive means we need better timeout handling

keep the connection open (for https).
reduce useless logging.

slip the command line filter into the main exec

replace some silly writestring(sprintf) calls with fprintf

include some more information in the error message sent to browser

Added tag v0.9.8 for changeset ce93d20d49b5

update readme to latest style

a tweak here and there to the filter rules

copyright

Added tag v0.9.7 for changeset 185ab726a7c3

silly to keep release.sh here

sometimes content is in .content

a bit more precision about head vs body

allow link tags such as found in head

reformat some code

chunked transfer encoding

in case we're not gzipping, use a bufio

possibly faster to escape and write in one pass

allow tables to have rowspan and colspan

include links to embedded youtube videos instead of hiding

the html we write will always be utf-8. prevent encoding mismatches.

a function to save unfiltered url for debugging troublesome sites

still need to send 200 when not intercepting

move outbound connection up earlier so we can report connect errors

tweak the locking to be a bit more efficient

rename some variables to make things easier to follow

start using context and deadlines. incomplete.

openbsd defaults to 2048 bit key, but make it explicit

clean up the cert cache expiry code a bit

stop using responsewriter after hijacking

move a function

Added tag v0.9.6 for changeset dba7d89250ad

oops, long standing bug in luainterface. forgot to pop return.
broke filtering after shared interpreters change.

Added tag v0.9.5 for changeset 43cd9b74804d

one lua interpreter per request should be enough

rework the filtering pass to avoid all the temp buffers.
should be bit leaner and faster now.

fixes and tweaks to filtering,
mostly to get busted blogspot pages working

govendor does a better job of vendoring

some sites use brotli, which isn't decoded. for now, hack around this
by forcing gzip accept-encoding instead of adding dependencies.

add a few more rules to filter.lua

tweak rules to be simpler

add a command line filter for testing and experimentation

Added tag v0.9.4 for changeset 360e7f70b8b7

clean up release dir a little

Added tag v0.9.3 for changeset 14024fd1ccf8

always name output miniwebproxy

Added tag v0.9.2 for changeset fb5ca99cad8d

rename resign.sh to just sign.sh

Added tag v0.9.1 for changeset ea3aa57467fb

release machinery

Added tag v0.9.0 for changeset 5d050db048ae

improve makefile

update some notes

not used here, but support more types in the luainterface reflector

do not pass bodybytes to lua. it's huge and inefficient.

allow the proxy to use a proxy, such as tor.

resort imports

go fmt

filtering on github and amazon is usually bad

remove annoying zipr div

proxy is supposed to do connection: close

sup

make sure outbound dial has a port

more bugs fixed by simply reusing request in http case

h4-h6 are ok tags

use io.WriteString instead of []byte casts

copy all the headers for http proxy. should just write it back.

stupid times has articles that inconsistently put img in figure
but sometimes leave it out.

add a simple signing script

some hosts do not like seeing a port number in host. strip it.

need to copy cookies for plain http.
probably need to do more, but this moves stuff along.

seems we should care about errors creating certs

allow to force reddit to old.reddit.com

can use init function to sort arrays

refine permitted tags a big. more table stuff

link to noscript parse bug issue

s is an allowed tag

remove obsolete filtering code. it lives in lua now.

m

belated status update

repair some image urls that hide in data attrs

allow skipping http too

don't print inside of script tag

sometimes the gist shit isn't in an iframe, but just a script

a few more selectors to find an article

m

move shouldfilter logic into lua

quick fix for multiple articles; don't rewrite yet

small fix to grab more header info

some sites like using picture. try to make it an img

much more aggressive about article filtering

quick fix to get filtering for plain http as well

make lua filters a bit more useful

start moving the filtering logic into a lua script

a case study in regridding homepages, with weird json special sauce

parse nearly all html responses.
allows filtering by indicators other than url.

miniwebproxy