Add an action button that allows a user to track time to a task from the List view (and other views where it makes sense) rather than having to open the task. I have multiple tasks per day that I need to track time to then change the due date but I don't need to see any details or leave any comments so opening the task is a waste of time.
The action button could be visible on mouse over, like the edit and add subtask buttons, or could be an optional column to be added to the view.
Adding it to the menu that pops up when you select a task wouldn't save any steps.