Where would you recommend starting with him? I've read The Library of Babel short story (because of this cool website: https://libraryofbabel.info/), but not sure where to go next.
He published a couple of short story anthologies in the 1940s: Fictions, Aleph - check your local library for a translation.
I smiled when in this lecture when he goes off on a tangent about Don Quixote and then imagines a fictional version of himself "I, for example, was born the same day as Jorge Luis Borges, exactly the same day".
That may well be Borges' inception concerning a fictional author with the nom de plume Pierre Menard. Ostensibly this is a lecture about Boswell but he has left a cue to an earlier short story.