# Number of channels

- Round up the number of channels in a layer to a multiple of 32 (32, 64, 96, 128, …), when designing
the network.
- In grouped convolution the group size is greater than 1, in contrast to normal convolution where the group size is 1.
What this means is that the input channels are grouped into a number of groups equal to group-size and each group is
convolved with a different group of filters. This is shown in the Figure 10 below:

![../../_static/resources/htp_guidelines_fig_10.png](data:image/png;base64,UklGRjgWAABXRUJQVlA4TCsWAAAvk8NtAPcGR5IkRVJlNe0xM5N6H7nfk3jyMnN3T+U3IEe2rVrZ+1z5rsRAHsRCwBRTH7k7XN+QHElSJHlk4+AyM11X+//n4G2YZ6oy5z8EpELJrlZXsiOzpgiFkl3Tw/on4QAVKJSU0a/BSRNGmp6t/taani1/V2Zfc8PFihBxKXZ2MKbkPNX6Byj9kPF7oSazCzesB0VhL+/Ulqi/hHmXPRa2aav8FXIKHCJDOGCpoFUEFQACIxYACIUAkUkzpkAFQSAgAgBBIAAHKGBABCKIQAdlRiRiXZEVQEAAYmiBxkayMxM1411pB5JCxZsx9RUOCQWEdVh3BERIs4I6AUDCOVEDKM4LTIQI0TgnYWJAgQEmShyjsF5IiOK8AeGCARAmJk4L6qAmQvhgnBcQ6gQmILwXoWxvsnwwtvrZo8Lqe2f5sLAGKFBBnQGwupc9DoSfgdHvxHzxLQva3OJ3r5RkkxJZHagTFyFvU85CriUOsTa3bQAcmNloCIQQpIFYN6CgcpDT4ZLVWOZSWbsalXkZc/0ACLtpIbSdNxzrLo9dP7z5P/1XvgubdKN9/c9S4fHcee/AsL/cijH5Pgk7k4nBF8A9YfBuSm3jZtv1515NPqbW/xu57NWW7ODao3twdnBm8fFJWfg6+vJ5jKPNkY/DDzHW0qQRQoWiuG3bKN5/7RytHLTfiFDgto1yYzz+RCwErYVbYTkVtHVZm+cS0Cr1GlxwPhm0Qttpum/a+fwkZhbnvwFnudHBfedzPK2k3tGSY4d3Fli9dDdu1xnPA2/a0e+Lb4AakLUJgNNKjqxyxVVvwpnaMMOEmVHh5JgZfWGmqZu6d/4QZsZjZqYwM8zC8V3wv+yzJHfLaqmtTtYR/afERpIjSWK2Tay41bqyqq/6a1na9jYWlFeT84xHWAtXidBV6KbIOeecM3uug8tgb4FZSQJdTOuXbB9Ou0WbENF/WLBtVW32HcuEIKQvL1xQj79KJNfov9F/o/9G/z04GEGfj2S8OtsILsMy7cGecKlFmt5OTLgTbsujiibH7ThSONkYIMX9n8yW3S+JRc/YM4wZjNqJJ8frttRd6xOMCFntRMuDhYVJ6QTxBEOD29/E0qrAk0+y0nYnk+wlGxjFgWE++dA44Zdn8flE3YFzrOS054Ut49cLhMIFZCBKn2EESsxIDfMkesRQ/LIt+R5wDYdsQUfHGVZSOl5pw3XLKuCURYv8jFK+njTVFMvks+xcEw9pHqs+Ml45gsjHKy2ct0wSXi/XkiebeYIKV3IurlpUvZBXJ1Gn840y1WKlX/bKYEwrlDTNQZXscLIh+sk5y0xs6UI3Z0FnhFl1uhmQRTNotFhZtGW0e0ra//1n9N92fnlG8sJnXjghefHTL56QvPSpl05IXv3kqyckr33stROStz7/1gnJH7/2xxOSX3zrFyckP/nBj09Ivv2rb5+QfPaVz56PvP1N9c23zxmuagJeX/yd+v0Xfx7wuipfuybsX6zP/1CTq8X9L7UbXpytrxiJ+8Gfr5WZ2vpx3yT59luP6ne+EXU//t1jhJZ2h6m6XXI8Or4Z95PufvGzR8lNrPyVmMDKBrw6Or4e95PT//jDB8kXwQTMR6nG8/K4/1Pwre8+RvCCfMUfpWjdC+N+sfNrX3+gYEiLbAB9fJwf9ycFefWrjxJSccuXqgGvjo9z4/7kWS996VGiHgA1QriAkP54gJwR9+3+F7/wGMFe8biqgSwPD/rQ+FLcn4z5hY8/TNAIxVbUqUcdGnXs/5cLDxPELqNQTHYiPkaLcMsaqjTglc8W9HmHFmp0JKn6JFZlbMCddwyVW46prsWiS+ZuTjhtZUZIZzVnIjnX0lnPQ0Rf2SPaOwdplcyi2lPS/m8eE8Xr1jMTCKKZwnpWrQUf7tKBLoE4l4A11gmyW3tJyETY2X6hcz46+p7/B7eu+JREqM94XigKsn1YIFhq+yfZPisQ5gYLZPuc1sLxX75TUEwghLWSxRqCSYSxKjlXJW9wMwjEfznIqhdVPf+cW1MUhJIJ1f99BFdfs4f5zYvNySQUqucOHGRJj8icoZJNPJ6zx4lr9rxOJAchec4eIgkJgxGVFmtoJCLqkk69XiyQqIOILBIJjtsCLiLu9HQ16XoPULvmdOMj4Je45qw6RSrdETEbH657UmWdupHu5Ode3GQv/HjG3Y9fgH/tQu0//Xwzy/OqjBNAlPql1h0hvna0+iVWUzf5Jogotay1O8zXjlbLSOUZ9RlVriki7sK1UmsvrQzRxodiWonU1HWqx0yqzj2eq3OsVnArmCg146UZWs0gZ53q4aGqyVfakN5gVkAxquWjVnAdpH/0ly32rOObiZzJHrNgAJKs1nbW5lsVdif85IewdaD+1fJKB8SX2v7aDNLh+G8mciZ7WIED2cA17asNjOSegkasDyyvdNEIyyvDpPVPYev9+pWVJtw0R7IF8FUDtq82OMyeQtBeBq6X9M9WdlgFXFqvDBDq2/lT/ZoFN62R6ifpcCylgWNPK1THf/LT4a1D2hDI7SngfpG/rH8eOaiZ8GFARzBjaSDh1FFTXoT4VaYDXUetDQO1p8APqJnwoa9YctUA4bBp6gbjvgDX5/VHPoeC21Ng05uqXbXx6cokG5PQmYPJG1ODPcL0vNmvMoR7A1z36Y/i4PYU2MHPjSQmmZgLjZC3pEekyXNXdzQmkHsKOUSsb+lRNyDawataEVIG7AGmxq+yiEDuKeQQqhAqBrk5ZTCNq1qRjzA1f5VFBHZPIYdIlVv2deoJbUVIAacOMLV+lcUDdk+BV9iwyCKeFHC1qz7KtK6beEDvKWQZXsSTSqYV+foAU8evsmi8Qe8p5Bd1P1lmosueR5jaIxqfEfrndo6hGwHgbBALjOwBpo4xPA23VbXrjInx19G8Lp6vsWWdZwYw1ZUJTkLaask8+UTENQQ/ziciC0tVtT0RAVdfLOQ8RNOweB4y1ewseZsOfWUzR1xy3yZs8r6Srpg3++A2W4W7tvy+PIhVyWljyVzQaD9R0NY872RJQ2mmumZP4GrzFHpGHNjKLy9ksRnlCLUiJM2CItHT4sCR5CW1REnyiiIkw+Y0ymoivKQ/dkKEZ+2qSSQeyh4Zcf0sL/JJJB3qfrLMpBwWKCQflAWMCAI7d93l7xS7BF92k4D1zN/dwii74VH5DYvKcDiUvPjTLWxZDn/Kc9hTpsOdch3mlOtMeFO2w5uyFr4lL+6kkGioyCYayvMqWMd+7wcBryPbMpn7ovhRh74OWBszTYYb1I3gguwQ8tpD7/s0NylmOUrFjyBPhbx20PvIAdyN4OZoR5+2gzPOq/IW5I3g5nohYY9M8WOu50jxmFJr5G3RLpAvcR3NUaX2yNrGhDC7jierY0odI8pCwj5C0JCmqMZFr2KO4BkH0TeCG2WOFB8gxLxZQEvM8lEHp0yeJvxtFkWfpBkjxkNyQ4ONw5AHCBO4PU+NpZSj6lF3EcOCML8DT1a9wQi6P1ggbEwTTjoUF8MCYw8RE1yCGmbbYNMwhB1KL7A/gLx9wBUaDsVC6CHmdi/maYYhSRVchmXaeN/9/kA3e3gBL2jqaglwqe6O3kEM7cPqEw1DUsoiTW/rBfYNGtvAk2P1OGeyY9NDXMA00icahqRRveVRRZPjpl5gN/AETmUE0xr5T2B7CA+h5qmGIek0sDbztKEXOMMcErobsnPxFirYuXqqFgNeOOTWnMEEjD0EoDaxaxiSTvNqz2W1FzgkpKluYETaJFQmGVCO0BjxR/FryhA6j8y2YUg6xe0DfC2PEZ6ki8NZOmL90DAn8JMSCpMc+sr7qSFmcMxkc7mW7CHSjiNmwG8bhiRSNXDfrtOvtSu4HjkfJeCEI/H5svpXvTB3EQ6WUAIoVUhXq0pLlwHYNAxJJ9s87llMgwl0QxJcgKlHMBj5x/vX1u9uWKQvMV1ESAgTEYGgci4B9JIv/gE2DUPSzBFqYtUL9CyVRuoewRHkH+/fyHFNLa9XXYSKYj7+EqWWLo9qaumKm4YhibRn2WjdC1zwcrm36g/af7xbBrmdhFrpGGYRpatd9aZhSEIFGboc5kmo8XOY0uELwmvLkmKaeOmteyJ0GFrEkzxKUfJ92DYMSehndEHaIGIl/pqPF4eA1tqilHCPLFpySWWmL4cFt2UYktZz30cPaR6rWElWV3QjlhQduOFa8sGF8kAQnsdkK9aDbBiGpPp6FIvWQkSqXdbmSkcYHkv0tNJpc6zko6ArZhvVNTur0w58FXD7Zyu2Vk1d6bOOqmSptt2PXiC7QZ1qX57O/ncEjUiqR/8dMz8/JfnM//3nvaPOE0nqPdh2lUi7niR8wAkfaNIH2t7CB9qTwgfaE8IHmvQBJn5gZTM/KvYZsd8rnQGoaLlyeFqs7bWoomFN5ubtAilelBqcKoe5eFiVuXmzAMpRMCNCc1Xm5s3SHbONCZK541TE5o1erMrcvFk64zYrtA/f890Wac1bbvKhIXPzxumKUUI5fjneSfBjjgzt41HL3Lx1OmKTz2gdyvFLXRjv+rzoovHxdHh6aHA3jzs2+cwxWvd+/HIa5JCpFVUMU7xfoMccIZ4eFuzN44wfUOm+j19eSHLSrRCqKJO7z+uHFv3NTQJYt+uPzR79MtgbwRVDIPo2WOVjttyyjxWV/jTQd5nK39RBrP/+z8tj2vPCoW8ERxyB6Fatez5+Kf7zSaNQ6ZaU0llq5LvP62yvVv58IoD13xr/WJG5KT+Dl6IjLeKvw94GdiyBaKbn45cz0i7xim8sV8l3mY2WPKqDWPjHFpmbBtPQQVX+Mm4DK56A1+r7+KXxCFuuLEv1GYy6y1xUVx6ReKzJ3PQEISQ7Z1XyA+5G2N+MKcAZ+j9+OThWzGml7jLX1fUSNfXH24evRRbxpICrXfWNcJwRTISuDiAImimA45cq2lyTLkGpm2fKkFu/22EuPio2sOVXPz4/yovquq4ovvHHi3iS0Fwv8nVF6MsIKEZXB9ADDK3yu81XVeODUrePrsZuaz8SV2MQFp4dV9YzSwQ/2Je6nywz0crV3MQGFaOrA+iBhaeuU7282e51+myhOSNY/UBWo2Gbh6Y8r3VGRe6TeaSrwyFkgzggWsEtbGT1cXUAPaA8KP39OwDwwZGhkbbak9iuH7hprIbYvmgg/3TfNuS1p979CcK8Xh1AFSSXvrcUVgA/WbIgpzmInD90h3n+UCAeD3ltq3eKnjeK4h1FFiAn5JZCb/ui/4zge1YEpqlra5A6z5aF5otiga7u3JBbCv2dPxSV/2S5hSLlGbYzKF2PwkPbOf/M2K7YnJjOOmC3FHo4z3Y13fNs1yZZzFpF7plUhJmOdSWd6zYZaqF4nZiuuvS9pbBzUXRej7J5CNejvBrfcxXKsqym06qaTCZknt+Ai7Ym/Z6OOqG3FLxdt/l6MNdtGr0vTv6N/mY2lO6v+UbFQ/AXo0WGu27oLQVyz29gFh9GMaGYCP5itMhwBoDfUqD2PEBGv4mPthOHJ+CL0aLEFUQoWwrbBcPo4fho+1v8/bw7gL8YLTIcgSC3FAg+r6zRI54sU9L2CNr0yuj5zIFzgWcJ+MVobU6GHUxYWwoB+LWRB0a/JOQXbZwXwD5LwC9G63UyrICwWwrknNjmgxkhbZyl5wTzuM91pvgsI7/wF6NFhhkUyX+WacRq88LodwHaakaMFetlofumEsxNxd/oMIqj09fmh9HDhPzlES+WrmMaD35Qwe5ZBppZ1D3iQ22R8Rhw/VX//hFPjB4J0aOw9Sf9EGdNT7Aoe5JrYMIMc0jFPD03h0rPio1Hgesx/QdfjAaiBGEnMTErpYZUda0pzjCXUQ+mV0ZN20A0gnuCCfcgK9DFVf8zHb57a6xBl9lQZMHsb+LSqgAWSLohxHW3/lZ6PPxIjHz/nS7Dg97JLJtwEMWBYWvWw331tH5kELPFI+vqv9+Lug3Mp93SdXnMvOeFL+PXhawKS4kKxwxKwhhKzEiNy1Df3qheWcfVTHHIjSVEYXneJRtBoJb60mn1vRpat1LxpQnfPN0ppWddspYEyi6Q3dC6vRFelXx5+wYGSXTghmvJ3OI7b/TV+Sg7bm+ksdV7Oqz64xGGxFvcKHPZcXuj8qYT+cG1zkOZbVTX7KykTc6ijMVoCMrzgWYXOSFMn25owIl2vM3VyqINo92HC994va+ub/Cv+q38zwQum1tnhfOqd+m7aDL67YwygzmvWqe+Ukkk9W59Z5RjRXZkm1LlIfBuYhqViSASPfBkDzjhAy3DWfA9AbAMx4DuCWBlJx7u4lHeZrwnAJWf+LiLRwuhK4CUoUDu4nGb3KquAFDOMoHfJ7dKL6SLhg6gOy4KCdsRYO/isSG3yiDNdwCdsZEjxY4AfxePniwrWEJ0cOkAumKXKO5Uf4mbPI5VHQH6Lh4NjI0KNJjDoJy0qzY+HTUdsctYCbqw2zxOTwC6Y0BPqIlZ9pJzLRRwUIdh59WOV8VREuOOXTSkKapx0Zs8Tu+Qs6poyK2SdbtDKXmdQ6OIccYuMa8ueln3OFMmTxP+/oO8i8dablUU3ZzhYEqe55jUuGKWTY+6t+5xHFWP+v4DuYtHjVPZOwitKFzZV6dS8oCSRlHjiGEWCBtT6XE0OKEQc7z/FXXfxWP1yGMYjW1F4TxXy6XkoSTWJMeOY9gcQHKk0KjAQrj764dA91PlCCXziidHyeBJVpQ8nqRR5FhxjAZfE/ANBulxQh0rSV1yPopHiLM2fHDVH1/Kr+lYEmPSY8Y+ujlYrTyOlnVn/P0H95LH/tn6tWSjSrZT6nCSRtFjxDPD1hcjmKoBLeJPtkfQWCkI+R8kXTFUg9yojiaZTXr2amMalUvwSAU7C+WmGgNeOOTGEqKyMfYHomQtCLlh0WVYLtftaJLZpKeNbUakTWJcZqD0Ay3oqp0qfhn+3bsO0EUlSNjLiG/UMCfwUz0u01feT8x15zmTTYmV/LtHqSAIxDZtC2XqHaV8vqz644W5B2DYYput47K/tkJJwyJLmtMOR5CC+f9GjhVb2xcGC52qpBH5wtqDXFnzZLZue41Iqkf/HTI/PyX5zP/9Z/Tf6L/Rf6P/Rv+N/hv99z+8uV/yoLpJ7uCSO6gEDybJg0j0wJM94IQPNOkDTPzAkj+gWKk8o111+9+dV2YUkHhJTWt7TVVGAYibStsZVU7RHTupqWPmFJ0xVGnPrKIrzsEMa2YV0PwcvuwmSnPmFdB3ezl8yah90akx8wrox3o5fMkoZTszC/en8DqmrDp/aDrg5ouXtas2Pl1FCTQfhy9ZpRxyc6m216KiBJqPw5dkPejJw7E5z3aihpvKYY4UaB4OX5JkdKq+C8vod/oBWv6sj1CDdS05JinQPBy+JMkOy2o9OowO23i4quxJCzT84UuarNDs6LAbsMOapHwHGv7wJVEPnjILz4oQu6E75mgBhz58SZSRB2aUWA3aYUyoMBci9OFLmv582iwfjCj5o9ngHXNQMUkpok6Y5UUbKWZDd8xm4pfGrLt8fPWMiH13HNw2fMdc6vlK4aLliCGcUhspkVyj/0b/jf4b/Tf6b/Tf6L/RfweIAgA=)

**Grouped Convolution**

- Here the input channels are grouped into **g** groups (2 groups in the figure above). Each group is convolved with its own
set of filters (Dark blue channels are convolved with dark green filters and light blue with light green). The outputs
from the convolution groups are then concatenated along channel dimension. To achieve better MAC/memory efficiency it
is important to keep the following in mind:

    - When doing grouped convolution, try to have more channels in a group up to the hardware capacity of 32.
    - For better efficiency use group convolution with group sizes greater than 1 and preferably with number of channels
being small power-of-2.
    - Do not choose group sizes to be unnessarily large. Choose group sizes as the smallest power-of-2 after which the
doubling of the group size doesn’t significantly increase the accuracy. E.g. if the group sizes 2 and 4 achieve similar
accuracy then select 2 as the group size

Last Published: Jun 04, 2026

[Previous Topic
Choice of Activation Functions](https://docs.qualcomm.com/bundle/publicresource/80-63442-10/topics/htp_guidelines_activation_functions.md) [Next Topic
Quantized 16 bit activations (A16) vs FP16 and Activation Fusion: Performance and power differences](https://docs.qualcomm.com/bundle/publicresource/80-63442-10/topics/htp_guidelines_a16_vs_fp16.md)