Let R be a unital commutative ring and A a unital R-algebra. We introduce the category of E(A,R)-modules which is a natural extension of the category of E-modules. The properties of E(A,R)-modules are studied; in particular we consider the subclass of E(R)-algebras. This subclass is of special interest since it coincides with the class of E-rings in the case R = ℤ. Assuming diamond ⋄, almost-free E(R)-algebras of cardinality κ are constructed for any regular non-weakly compact cardinal κ > ℵ ₀ and suitable R. The set-theoretic hypothesis can be weakened.