Using memory-based layers