一般来说,批量插入可以使用 MyBatisPlus 中 ServiceImpl 自带的方法 saveBatch
打开 sql 日志,application.yml 添加配置,mapper-locations 配置 mapper 路径
mybatis-plus:configuration:log-impl: org.apache.ibatis.logging.stdout.StdOutImpl #开启sql日志mapper-locations: classpath*:mapper/**/*Mapper.xml
可以发现插入是在同一个 SqlSession,但并不是理想中的批量插入
它的插入算法我没有细究,但从日志观察可以看出它的插入条数是无序的,如果可以一次插入全部,效率应该更高
MyBatisPlus 预留了 insertBatchSomeColumn 方法,可以实现批量插入,下面介绍一下如何配置
com.baomidou mybatis-plus-boot-starter 3.5.2
import com.baomidou.mybatisplus.annotation.FieldFill;
import com.baomidou.mybatisplus.core.injector.AbstractMethod;
import com.baomidou.mybatisplus.core.injector.DefaultSqlInjector;
import com.baomidou.mybatisplus.core.metadata.TableInfo;
import com.baomidou.mybatisplus.extension.injector.methods.InsertBatchSomeColumn;
import java.util.List;public class BatchSqlInjector extends DefaultSqlInjector {@Overridepublic List getMethodList(Class> mapperClass, TableInfo tableInfo) {List methodList = super.getMethodList(mapperClass, tableInfo);methodList.add(new InsertBatchSomeColumn(i -> i.getFieldFill() != FieldFill.UPDATE));return methodList;}}
import com.baomidou.mybatisplus.annotation.DbType;
import com.baomidou.mybatisplus.extension.plugins.MybatisPlusInterceptor;
import com.baomidou.mybatisplus.extension.plugins.inner.BlockAttackInnerInterceptor;
import com.baomidou.mybatisplus.extension.plugins.inner.PaginationInnerInterceptor;
import org.springframework.context.annotation.Bean;
import org.springframework.context.annotation.Configuration;
import org.springframework.transaction.annotation.EnableTransactionManagement;@EnableTransactionManagement
@Configuration
public class MybatisPlusConfig {/*** 分页插件** @return*/@Beanpublic MybatisPlusInterceptor mybatisPlusInterceptor() {MybatisPlusInterceptor interceptor = new MybatisPlusInterceptor();interceptor.addInnerInterceptor(new BlockAttackInnerInterceptor());PaginationInnerInterceptor pageInterceptor = new PaginationInnerInterceptor(DbType.MYSQL);pageInterceptor.setMaxLimit(500L);pageInterceptor.setOptimizeJoin(true);interceptor.addInnerInterceptor(pageInterceptor);return interceptor;}/*** 批量插入** @return*/@Beanpublic BatchSqlInjector easySqlInjector() {return new BatchSqlInjector();}
}
import com.baomidou.mybatisplus.core.mapper.BaseMapper;
import java.util.Collection;public interface BatchBaseMapper extends BaseMapper {/*** 批量插入 仅适用于mysql** @param entityList 实体列表* @return 影响行数*/Integer insertBatchSomeColumn(Collection entityList);
}
@Repository
public interface ISapCustomerMapper extends BatchBaseMapper {}
public class SapCustomerServiceImpl extends ServiceImpl {void createBatch(List entityList) {if(!entityList.isEmpty()){baseMapper.insertBatchSomeColumn(entityList);}}}
注意:不建议直接用 mapper 的 insertBatchSomeColumn 方法,因为当 entityList 为空时会报错
其实就是 INSERT INTO 表名(字段1,字段2,字段3) VALUES 后面为空
NestedRuntimeException:You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ‘’ at line 1
3600 条数据
优化前:2058 毫秒
优化后:1293 毫秒
15000 条数据
优化前:8958 毫秒
优化后:2037 毫秒
可以看出,数据越多,优化效果越明细
通过这次测试发现,打开 sql 日志后,会明细拖慢 sql 执行效率,数据越多越明细