JohnX maintain FBReader in OE so I will leave it for him.
From my look at source you hardcode many build params already. Can some of them be passed to make during compilation? Things like CC, LD, INCDIR, LIBDIR...
Generally we (OE team) prefer to avoid machine dependent packages as much as possible - one package for qvga/vga/svga/xga etc devices if possible.