For multi-task mobile edge computing(MEC) systems in satellite Internet of Things(IoT), there are dependencies between different tasks, which need to be collected and jointly offloaded. It is crucial to allocate the computing and communication resources reasonably due to the scarcity of satellite communication and computing resources. To address this issue, we propose a joint multi-task offloading and resource allocation scheme in satellite IoT to improve the offloading efficiency. We first construct a novel resource allocation and task scheduling system in which tasks are collected and decided by multiple unmanned aerial vehicles(UAV) based aerial base stations, the edge computing services are provided by satellites. Furthermore, we investigate the multi-task joint computation offloading problem in the framework. Specifically, we model tasks with dependencies as directed acyclic graphs(DAG), then we propose an attention mechanism and proximal policy optimization (A-PPO) collaborative algorithm to learn the best offloading strategy. The simulation results show that the A-PPO algorithm can converge in 25 steps. Furthermore, the A-PPO algorithm reduces cost by at least 8.87$\%$ by default compared to several baseline algorithms. In summary, this paper provides a new insight for cost optimization of multi-task MEC system in satellite IoT.