Usar funciones de ventana:
select *
from (
select col1,
col2,
row_number() over (order by some_column) as rn,
count(*) over () as total_count
from the_table
)
where rn <= 4;
Pero si esa mesa es realmente grande, no va a ser muy rápida.