What does stateful mean regarding firewalls?

A stateful firewall keeps states of the traffic that goes in one direction to allow the responses to come back in the opposite direction. This is implicit, there is no need to define the rule in the opposite direction.

A stateful firewall must have rules that match the traffic in both directions. If the traffic is allowed inbound by a rule, then a explicit rule must allow the reply traffic to pass outbound.