Applying GPGPU to Recurrent Neural Network Language Model based Fast Network Search in the Real-Time LVCSR
Table 3: The composition and the size of an element in IndexTable (in bytes)
['[EMPTY]', 'Total Memory', '# of Elem.', 'Size of Elem.']
Another measure to consider is the memory footprint of the IndexTable. Whereas Cache elements consists of only four integer values, each element in IndexTable is as large as a few hundred bytes and may increase rapidly as the decoding goes on. The size of the whole table increases during the decoding process and it is proportional to the number of unique elements.