Can I override 'memo is required for time entry' rule for specific activities?

No, but you can save time by adding the memo directly to the activity item. From the side menu, open Settings > Time & Expenses and click Activity Items. Choose an activity item from the grid and view the details. On the details screen, include the memo so that whenever the activity is billed, the memo is also included.