The crafting system searches all the tiles in reach to determine what ingredients you have available, so if you are surrounded by a ton of stuff it’s going to slow you down. I don’t know of any way to speed it up aside from clean up your surroundings of any junk, maybe consolidate separate piles of the same stuff into the same pile.