What is a generator and when should you use one?
Interviewer Expectations for this Question
01
Core Competency
Assesses fundamental understanding of Python conventions, runtime behavior, and memory/performance considerations.
02
Evaluation Criteria
Hiring managers look for precision, avoidance of ambiguous jargon, and ability to explain trade-offs under real production conditions.
Comprehensive Model Answer
Verified Solution
A generator is a function that yields values lazily using yield. Calling it returns a generator object that produces items on demand and remembers its position, so memory stays O(1) instead of materialising the whole sequence.
def read_lines(path):
with open(path) as f:
for line in f:
yield line.strip()
# process a huge file without loading it all into memory
for line in read_lines('big.log'):
...
Use generators for streaming data, pipelines and infinite sequences. They are also the foundation of async, where an async generator yields with async for.
Candidate Response Strategy & Interview Tips
- Start with a concise one-sentence summary: Deliver a direct, confident answer first before expanding into nuances.
- Demonstrate real-world trade-offs: Discuss where this approach excels and when you would avoid it in production systems.
- Discuss complexity & edge cases: Proactively explain time/space complexity or boundary conditions (null values, scale limits).
- Prepare for interviewer follow-ups: Technical hiring panels frequently probe deeper into concurrency, backward compatibility, or alternative libraries.