We present a simple method for structural inference in African Kuba cloth, and Moorish zillij mosaics. Our work is based on Stiny and Gips formulation of Shape Grammars. It provides art scholars and geometers with a simple yet powerful medium to perform analysis of existing art and draw inspiration for new designs. The analysis involves studying an artwork and capturing its structure as simple shape grammar rules. We then show how interesting families of artworks could be generated using simple variations in their corresponding grammars.