Can I stop Time Tracker from seeing every database record?


I have a view which shows tasks/records from the current week and then I have Time Tracker block installed, but Time Tracker sees tasks from outside this view. Is there a way to limit the tasks that it can see?

If not, then it will become impossible to use as soon as I have lots of records, since I’d have to search to find a record in maybe 100 tasks.