本文在我的技术博客【鸟不拉屎】同步发布,详情可猛戳 亦可扫描文章末尾二维码关注我的公众号【鸟不拉屎】html
实际业务场景中,不可能只有一个库,因此就有了分库分表,多数据源的出现。实现了读写分离,主库负责增改删,从库负责查询。这篇文章将实现Spring Boot如何实现多数据源,动态数据源切换,读写分离等操做。java
快速新建项目spring-boot项目mysql
<dependency>
<groupId>org.springframework.boot</groupId>
<artifactId>spring-boot-starter-web</artifactId>
</dependency>
<dependency>
<groupId>org.mybatis.spring.boot</groupId>
<artifactId>mybatis-spring-boot-starter</artifactId>
<version>2.0.1</version>
</dependency>
<dependency>
<groupId>org.springframework.boot</groupId>
<artifactId>spring-boot-starter-test</artifactId>
<scope>test</scope>
</dependency>
<dependency>
<groupId>org.springframework.boot</groupId>
<artifactId>spring-boot-starter</artifactId>
</dependency>
<dependency>
<groupId>mysql</groupId>
<artifactId>mysql-connector-java</artifactId>
<scope>runtime</scope>
</dependency>
<dependency>
<groupId>org.projectlombok</groupId>
<artifactId>lombok</artifactId>
<optional>true</optional>
</dependency>
复制代码
和以前教程同样,首先配置application.ymlgit
#指定配置文件为test
spring:
profiles:
active: test
#配置Mybatis
mybatis:
configuration:
# 开启驼峰命名转换,如:Table(create_time) -> Entity(createTime)。不须要咱们关心怎么进行字段匹配,mybatis会自动识别`大写字母与下划线`
map-underscore-to-camel-case: true
#打印SQL日志
logging:
level:
com.niaobulashi.mapper.*: DEBUG
复制代码
其中打印SQL日志这块,由于是多数据源,在mapper包下面区分不一样的数据库来源xml文件,因此用*表示。github
配置application-test.yml以下web
spring:
datasource:
#主库
master:
jdbc-url: jdbc:mysql://127.0.0.1:3306/test?serverTimezone=UTC&useUnicode=true&characterEncoding=utf-8&useSSL=true
username: root
password: root
driver-class-name: com.mysql.cj.jdbc.Driver
#从库
slave:
jdbc-url: jdbc:mysql://127.0.0.1:3306/test2?serverTimezone=UTC&useUnicode=true&characterEncoding=utf-8&useSSL=true
username: root
password: root
driver-class-name: com.mysql.cj.jdbc.Driver
复制代码
从spring.datasource节点开始,区分主库master,从库slave。主库链接的数据库为test,从库链接的数据库为test2。spring
注意:这里须要注意的是,从Spring Boot2开始,在配置多数据源时有些配置发生了变化,网上许多教程使用的是spring.datasource.url
。会出现jdbcUrl is required with driverClassName.
的问题。sql
解决方法:配置多数据源时,将spring.datasource.url
配置改成spring.datasource.jdbc-url
数据库
依据知名博主:纯洁的微笑,写的博文咱们来分析一波apache
首先看主库配置的代码:
@Configuration
@MapperScan(basePackages = "com.niaobulashi.mapper.master", sqlSessionTemplateRef = "masterSqlSessionTemplate")
public class DataSourceMasterConfig {
/** * 是application-test.yml中的spring.datasource.master配置生效 * @return */
@Bean(name = "masterDataSource")
@ConfigurationProperties(prefix = "spring.datasource.master")
@Primary
public DataSource masterDataSource() {
return DataSourceBuilder.create().build();
}
/** * 将配置信息注入到SqlSessionFactoryBean中 * @param dataSource 数据库链接信息 * @return * @throws Exception */
@Bean(name = "masterSqlSessionFactory")
@Primary
public SqlSessionFactory masterSqlSessionFactory(@Qualifier("masterDataSource") DataSource dataSource) throws Exception {
SqlSessionFactoryBean bean = new SqlSessionFactoryBean();
bean.setDataSource(dataSource);
bean.setMapperLocations(new PathMatchingResourcePatternResolver().getResources("classpath:mapper/master/*.xml"));
return bean.getObject();
}
/** * 事务管理器,在实例化时注入主库master * @param dataSource * @return */
@Bean(name = "masterTransactionManager")
@Primary
public DataSourceTransactionManager masterTransactionManager(@Qualifier("masterDataSource") DataSource dataSource) {
return new DataSourceTransactionManager(dataSource);
}
/** * SqlSessionTemplate具备线程安全性 * @param sqlSessionFactory * @return * @throws Exception */
@Bean(name = "masterSqlSessionTemplate")
@Primary
public SqlSessionTemplate masterSqlSessionTemplate(@Qualifier("masterSqlSessionFactory") SqlSessionFactory sqlSessionFactory) throws Exception {
return new SqlSessionTemplate(sqlSessionFactory);
}
}
复制代码
问题:看这块masterSqlSessionFactory
,SqlSessionFactoryBean
只获取了spring.datasource.master
数据库链接信息,并无获取多数据库的配置信息mybatis.configuration
致使咱们须要配置驼峰命名规则,配置信息并无注入到SqlSessionFactoryBean
。这样就致使在查询是,遇到下划线没法解析相应字段user_id,dept_id,create_time
解决方法:在配置中添加Configuration
同时,将配置信息注入到SqlSessionFactoryBean
/** * 将配置信息注入到SqlSessionFactoryBean中 * @param dataSource 数据库链接信息 * @return * @throws Exception */
@Bean(name = "slaveSqlSessionFactory")
public SqlSessionFactory slaveSqlSessionFactory(@Qualifier("slaveDataSource") DataSource dataSource) throws Exception {
SqlSessionFactoryBean bean = new SqlSessionFactoryBean();
// 使配置信息加载到类中,再注入到SqlSessionFactoryBean
org.apache.ibatis.session.Configuration configuration = new org.apache.ibatis.session.Configuration();
configuration.setMapUnderscoreToCamelCase(true);
bean.setConfiguration(configuration);
bean.setDataSource(dataSource);
bean.setMapperLocations(new PathMatchingResourcePatternResolver().getResources("classpath:mapper/slave/*.xml"));
return bean.getObject();
}
复制代码
和添加主库配置信息同样,只不过不一样的是,不须要添加@Primary
首选注解
代码以下
@Configuration
@MapperScan(basePackages = "com.niaobulashi.mapper.slave", sqlSessionTemplateRef = "slaveSqlSessionTemplate")
public class DataSourceSlaveConfig {
/** * 是application-test.yml中的spring.datasource.master配置生效 * @return */
@Bean(name = "slaveDataSource")
@ConfigurationProperties(prefix = "spring.datasource.slave")
public DataSource slaveDataSource() {
return DataSourceBuilder.create().build();
}
/** * 将配置信息注入到SqlSessionFactoryBean中 * @param dataSource 数据库链接信息 * @return * @throws Exception */
@Bean(name = "slaveSqlSessionFactory")
public SqlSessionFactory slaveSqlSessionFactory(@Qualifier("slaveDataSource") DataSource dataSource) throws Exception {
SqlSessionFactoryBean bean = new SqlSessionFactoryBean();
// 使配置信息加载到类中,再注入到SqlSessionFactoryBean
org.apache.ibatis.session.Configuration configuration = new org.apache.ibatis.session.Configuration();
configuration.setMapUnderscoreToCamelCase(true);
bean.setConfiguration(configuration);
bean.setDataSource(dataSource);
bean.setMapperLocations(new PathMatchingResourcePatternResolver().getResources("classpath:mapper/slave/*.xml"));
return bean.getObject();
}
/** * 事务管理器,在实例化时注入主库master * @param dataSource * @return */
@Bean(name = "slaveTransactionManager")
public DataSourceTransactionManager slaveTransactionManager(@Qualifier("slaveDataSource") DataSource dataSource) {
return new DataSourceTransactionManager(dataSource);
}
/** * SqlSessionTemplate具备线程安全性 * @param sqlSessionFactory * @return * @throws Exception */
@Bean(name = "slaveSqlSessionTemplate")
public SqlSessionTemplate slaveSqlSessionTemplate(@Qualifier("slaveSqlSessionFactory") SqlSessionFactory sqlSessionFactory) throws Exception {
return new SqlSessionTemplate(sqlSessionFactory);
}
}
复制代码
在网上还看到这样一种配置,单独经过@ConfigurationProperties注解配置Mybatis的配置信息以下
/** * 试application.yml中的mybatis.configuration配置生效,若是不主动配置,因为@Order配置顺序不一样,讲致使配置不能及时生效 * 使配置信息加载到类中,再注入到SqlSessionFactoryBean * @return */
@Bean
@ConfigurationProperties(prefix = "mybatis.configuration")
public org.apache.ibatis.session.Configuration configuration() {
return new org.apache.ibatis.session.Configuration();
}
复制代码
其中prefix
,在主库和从库中的id是同样的,必须保持不一样,不然idea就会提示报错Duplicate prefix
致使只有主库能够执行Mybatis的配置,从库无效。
@Bean(name = "masterSqlSessionFactory")
@Primary
public SqlSessionFactory masterSqlSessionFactory(@Qualifier("masterDataSource") DataSource dataSource, org.apache.ibatis.session.Configuration configuration) throws Exception {
SqlSessionFactoryBean bean = new SqlSessionFactoryBean();
// 使配置信息加载到类中,再注入到SqlSessionFactoryBean
bean.setConfiguration(configuration);
bean.setDataSource(dataSource);
bean.setMapperLocations(new PathMatchingResourcePatternResolver().getResources("classpath:mapper/master/*.xml"));
return bean.getObject();
}
复制代码
这块验证只有主库有效,从库的驼峰方法解析无效。后续再来研究下。。。
代码结构以下
其中SysUserMasterDao代码
public interface SysUserMasterDao {
/** * 根据userId查询用户信息 * @param userId 用户ID */
List<SysUserEntity> queryUserInfo(Long userId);
/** * 查询全部用户信息 */
List<SysUserEntity> queryUserAll();
/** * 根据userId更新用户的邮箱和手机号 * @return */
int updateUserInfo(SysUserEntity user);
}
复制代码
SysCodeMasterDao.xml
<mapper namespace="com.niaobulashi.mapper.master.SysUserMasterDao">
<!--查询全部用户信息-->
<select id="queryUserAll" resultType="com.niaobulashi.entity.SysUserEntity">
SELECT
ur.*
FROM
sys_user ur
WHERE
1 = 1
</select>
<!--根据用户userId查询用户信息-->
<select id="queryUserInfo" resultType="com.niaobulashi.entity.SysUserEntity">
SELECT
ur.*
FROM
sys_user ur
WHERE
1 = 1
AND ur.user_id = #{userId}
</select>
<!-- 根据UserId,更新邮箱和手机号 -->
<update id="updateUserInfo" parameterType="com.niaobulashi.entity.SysUserEntity">
UPDATE sys_user u
<set>
<if test="email != null">
u.email = #{email},
</if>
<if test="mobile != null">
u.mobile = #{mobile},
</if>
</set>
WHERE
u.user_id = #{userId}
</update>
</mapper>
复制代码
八、Controller层测试
@RestController
public class SysUserController {
@Autowired
private SysUserMasterDao sysUserMasterDao;
@Autowired
private SysUserSlaveDao sysUserSlaveDao;
/** * 查询全部用户信息Master * @return */
@RequestMapping("/getUserMasterAll")
private List<SysUserEntity> getUserMaster() {
System.out.println("查询主库");
List<SysUserEntity> userList = sysUserMasterDao.queryUserAll();
return userList;
}
/** * 查询全部用户信息Slave * @return */
@RequestMapping("/getUserSlaveAll")
private List<SysUserEntity> getUserSlave() {
System.out.println("查询从库");
List<SysUserEntity> userList = sysUserSlaveDao.queryUserAll();
return userList;
}
/** * 根据userId查询用户信息Master * @return */
@RequestMapping("/getUserMasterById")
private List<SysUserEntity> getUserMasterById(@RequestParam(value = "userId", required = false) Long userId) {
List<SysUserEntity> userList = sysUserMasterDao.queryUserInfo(userId);
return userList;
}
/** * 根据userId查询用户信息Slave * @return */
@RequestMapping("/getUserSlaveById")
private List<SysUserEntity> getUserSlaveById(@RequestParam(value = "userId", required = false) Long userId) {
List<SysUserEntity> userList = sysUserSlaveDao.queryUserInfo(userId);
return userList;
}
}
复制代码
主库:http://localhost:8080/getUserMasterAll
从库:http://localhost:8080/getUserSlaveAll
一、经过多数据源方式实现数据库层面的读写分离
二、多数据源连接数据库是,使用spring.datasource.jdbc-url
三、多数据源的mybatis.configuration配置注意须要手动注入SqlSessionFactory
鸟不拉屎:一个正在努力Coding的将来架构师