Skip to content

Commit

Permalink
turing work learn.
Browse files Browse the repository at this point in the history
  • Loading branch information
杜文凯 committed Feb 1, 2023
1 parent 9a2e5d0 commit 02fd0ff
Show file tree
Hide file tree
Showing 64 changed files with 5,630 additions and 17 deletions.
412 changes: 412 additions & 0 deletions qy.csv

Large diffs are not rendered by default.

34 changes: 34 additions & 0 deletions 人工智能/AIGC/aigc.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,34 @@
# AIGC(AI-Generated Content 人工智能生成内容)
AIGC(利用AI技术自动生成内容的生产方式)概念在二级市场吸睛无数,其概念股美图公司(1357.HK)、蓝色光标(300058.SZ)、恒信东方(300081.SZ)等股价出现不同幅度的上涨。
而近期在国内社交网络“火出天际”的AI绘画软件则主要集中在小程序及APP,如意间AI绘画、盗梦师、Style art、滴墨社区、Uni Dream等,以及网站draft.art等。其中,根据小程序“意间AI绘画”披露的后台数据,自2022年9月30日平台上线到2022年11月12日,平台用户由0增长到了117万人,其中,11月11日单日用户增加65.7万人。

https://github.com/topics/aigc

# AIGC 应用

2014年的时候,我在互联网企业里做内容工作,当时业内很流行凯文·凯利的“一千个粉丝”理论,相信“找到一千个种子用户,产品就能够活下去”。

找到种子用户干嘛呢?核心KPI之一,就是鼓励他们创造内容,提高平台的UGC数量与质量。

普通人也轻松能创作的图文短视频,用爱发电的同人衍生,极具创意的鬼畜视频……UGC(User-generated content用户生产内容),以高效、丰富、多元的产出方式,和PGC(Professional-generated content专家生产内容)、OGC(Occupationally-generated Content职业生产内容)一起,让互联网数字内容呈现出前所未有的繁荣多彩。

modelscope

https://mp.weixin.qq.com/s/fOyvo0VQpl4IaY3avx8BOA

https://www.modelscope.cn/models/damo/cv_diffusion_text-to-image-synthesis/summary

https://www.woshipm.com/ai/5324146.html

https://www.jasper.ai/blog/ai-content-generator


# MLOPS

https://blog.csdn.net/DolphinScheduler/article/details/125494721

https://zhuanlan.zhihu.com/p/554210516

https://github.com/apache/dolphinscheduler/issues/9725

https://www.infoq.com/articles/apache-dolphinscheduler-mlops/
13 changes: 13 additions & 0 deletions 人工智能/AIGC/社交平台登录/login.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
# 积木内置justauth

```mvn
<dependency>
<groupId>com.xkcoding.justauth</groupId>
<artifactId>justauth-spring-boot-starter</artifactId>
<version>1.4.0</version>
</dependency>
```

https://github.com/justauth/justauth-spring-boot-starter

https://xie.infoq.cn/article/e6b9817b017a06c8d645de529
9 changes: 8 additions & 1 deletion 人工智能/NLP/nlp.md
Original file line number Diff line number Diff line change
Expand Up @@ -151,4 +151,11 @@ Search Guard所有基本安全功能(非全部)都是免费的,并且内

地址:https://www.oschina.net/p/searchguard

https://gitee.com/mirrors/SearchGuard
https://gitee.com/mirrors/SearchGuard


# 句法分析与依存解析

https://www.showmeai.tech/article-detail/237

https://web.stanford.edu/class/cs224n/
9 changes: 8 additions & 1 deletion 人工智能/NLP/transformer/Transformer.md
Original file line number Diff line number Diff line change
Expand Up @@ -158,4 +158,11 @@ https://lonepatient.top/2019/07/14/transformer_xl

## 模型加载和下游任务使用

https://dxzmpk.github.io/2020/04/23/HuggingFace-transformers%E7%B3%BB%E5%88%97%E7%9A%84%E4%BB%8B%E7%BB%8D%E4%BB%A5%E5%8F%8A%E5%9C%A8%E4%B8%8B%E6%B8%B8%E4%BB%BB%E5%8A%A1%E4%B8%AD%E7%9A%84%E4%BD%BF%E7%94%A8/
https://dxzmpk.github.io/2020/04/23/HuggingFace-transformers%E7%B3%BB%E5%88%97%E7%9A%84%E4%BB%8B%E7%BB%8D%E4%BB%A5%E5%8F%8A%E5%9C%A8%E4%B8%8B%E6%B8%B8%E4%BB%BB%E5%8A%A1%E4%B8%AD%E7%9A%84%E4%BD%BF%E7%94%A8/


# Transformers源码阅读

## Transformers包tokenizer.encode

https://blog.csdn.net/qq_33293040/article/details/105439750
4 changes: 4 additions & 0 deletions 人工智能/人工智能平台/byzer/byzer.md
Original file line number Diff line number Diff line change
Expand Up @@ -618,3 +618,7 @@ load

DataFrameReader
jdbc


# jdbc 保存很慢
https://blog.csdn.net/lovetechlovelife/article/details/112471839
189 changes: 189 additions & 0 deletions 人工智能/人工智能平台/低代码平台/jeecg-boot.md
Original file line number Diff line number Diff line change
Expand Up @@ -25,3 +25,192 @@ http://doc.jeecg.com/2043926
http://www.jeecg.com/doc/download


# 积木代码解读

核心模块

```mvn
<modules>
<module>jeecg-boot-base</module>
<module>jeecg-boot-module-system</module>
<module>jeecg-boot-module</module>
<module>hitechpark-modules</module>
<module>jeecg-boot-platform</module>
<module>metrics</module>
<!-- 新增元数据模块-->
<module>metadata</module>
<!-- 新增数据管理模块-->
<module>datamanager</module>
<!-- 微服务开发解开注释
<module>jeecg-boot-starter</module>
<module>jeecg-cloud-module</module>-->
</modules>
```

## jeecg-boot-base
积木基础代码

- jeecg-boot-base-api
存放常用api的接口的地方
- jeecg-boot-base-core
存放分页, 配置, oss/minio存储, 日志记录, 加密, 数据权限和常用工具的地方.
- jeecg-boot-base-tools

### threadPoolConfig

```java
// 使用Spring封装的异步线程池
ThreadPoolTaskExecutor executor = new ThreadPoolTaskExecutor();
// 初始化线程数
executor.setCorePoolSize(corePoolSize);
// 最大线程数
executor.setMaxPoolSize(maxPoolSize);
// 缓冲队列
executor.setQueueCapacity(queueCapacity);
// 允许空闲时间/秒
executor.setKeepAliveSeconds(keepAliveSeconds);
// 线程池名前缀-方便日志查找
executor.setThreadNamePrefix(threadNamePrefix);
executor.setRejectedExecutionHandler(new ThreadPoolExecutor.CallerRunsPolicy());
executor.setWaitForTasksToCompleteOnShutdown(waitForTasksToCompleteOnShutdown);
executor.setAwaitTerminationSeconds(awaitTerminationSeconds);
// 初始化
executor.initialize();
```

JDK 提供了四种内置拒绝策略,我们要理解并记住,有如下的四种:
1、DiscardPolicy: 默默丢弃无法处理的任务,不予任何处理
2、DiscardOldestPolicy: 丢弃队列中最老的任务, 尝试再次提交当前任务
3、AbortPolicy: 直接抛异常,阻止系统正常工作。
4、CallerRunsPolicy: 将任务分给调用线程来执行,运行当前被丢弃的任务,这样做不会真的丢弃任务,但是提交的线程性能有可能急剧下降。

https://blog.csdn.net/u010834071/article/details/80655777


## jeecg-boot-system

- cas
单点登录
- quartz
定时任务使用
quartzJob curd

Scheduler、Job 、JobDetail、Trigger四个类.

@PersistJobDataAfterExecution
@PersistJobDataAfterExecution:告诉Quartz在成功执行了Job实现类的execute方法后(没有发生任何异常),更新JobDetail中JobDataMap的数据,使得该JobDetail实例在下一次执行的时候,JobDataMap中是更新后的数据,而不是更新前的旧数据。
@DisallowConcurrentExecution

```yaml
## quartz定时任务,采用数据库方式
quartz:
job-store-type: jdbc
initialize-schema: embedded
#设置自动启动,默认为 true
auto-startup: true
#启动时更新己存在的Job
overwrite-existing-jobs: true
properties:
org:
quartz:
scheduler:
instanceName: MyScheduler
instanceId: AUTO
jobStore:
class: org.quartz.impl.jdbcjobstore.JobStoreTX
driverDelegateClass: org.quartz.impl.jdbcjobstore.StdJDBCDelegate
tablePrefix: QRTZ_
isClustered: true
misfireThreshold: 60000
clusterCheckinInterval: 10000
threadPool:
class: org.quartz.simpl.SimpleThreadPool
threadCount: 10
threadPriority: 5
threadsInheritContextClassLoaderOfInitializingThread: true
```
```java
/**
* 添加定时任务
*
* @param jobClassName
* @param cronExpression
* @param parameter
*/
private void schedulerAdd(String jobClassName, String cronExpression, String parameter) {
try {
// 启动调度器
scheduler.start();

// 构建job信息
JobDetail jobDetail = JobBuilder.newJob(getClass(jobClassName).getClass()).withIdentity(jobClassName).usingJobData("parameter", parameter).build();

// 表达式调度构建器(即任务执行的时间)
CronScheduleBuilder scheduleBuilder = CronScheduleBuilder.cronSchedule(cronExpression);

// 按新的cronExpression表达式构建一个新的trigger
CronTrigger trigger = TriggerBuilder.newTrigger().withIdentity(jobClassName).withSchedule(scheduleBuilder).build();

scheduler.scheduleJob(jobDetail, trigger);
} catch (SchedulerException e) {
throw new JeecgBootException("创建定时任务失败", e);
} catch (RuntimeException e) {
throw new JeecgBootException(e.getMessage(), e);
}catch (Exception e) {
throw new JeecgBootException("后台找不到该类名:" + jobClassName, e);
}
}
```

https://www.jianshu.com/p/06c4307214b7

https://blog.csdn.net/wh_07/article/details/111063023

- message
消息通知


## jeecg-boot-oa

oa和activity 工作流引擎

功能模块包含
- im在线聊天
EoaChatUserGroup
群和讨论组表成员表

EoaChatUser
用户表

EoaChatRealTime
用户实时消息表

EoaChatOffMessage
离线消息表

EoaChatHistorical
用户历史消息表

EoaChatGrouping

EoaChatGroup

EoaChatFriend
朋友

EoaCharUserGrouping
组和朋友

EoaCharMsg
消息盒子

- email邮件
邮件类别表; 邮件附件表; 邮件信息表; 邮件往来记录表;

- 文件管理


https://blog.xxleee.com/pages/ecology/activiti/introduction/
64 changes: 64 additions & 0 deletions 人工智能/区块链/wefe.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,64 @@
# 源码拆解

orm
```java
AbstractBlockChainEntity
AbstractEntity
AbstractUniqueIDEntity

log_time
updated_time
created_time
id uuid

base Entity + 自有的attr


SDK supports CNS. CnsService can configure CNS. The APIs are here:

String registerCns(String name, String version, String address, String abi): register CNS according to contract name, version, address and contract abi.
String getAddressByContractNameAndVersion(String contractNameAndVersion): inquire contract address according to contract name and version (connected with colon). If lack of contract version, it is defaulted to be the latest version.
List<CnsInfo> queryCnsByName(String name): inquire CNS information according to contract name.
List<CnsInfo> queryCnsByNameAndVersion(String name, String version): inquire CNS information according to contract name and version.


// 初始化RPC Server
Map<String, RpcServerAnnotate> rpcClassBeans = ClassUtil.loadRpcClassBeans();
if (rpcClassBeans.isEmpty()) {
throw new Exception("start rpc server fail, is not exist available gRpc server.");
}
// Binding port
NettyServerBuilder serverBuilder = NettyServerBuilder.forPort(configProperties.getRpcServerPort());

for (Map.Entry<String, RpcServerAnnotate> entry : rpcClassBeans.entrySet()) {
RpcServerAnnotate rpcServerAnnotateConfig = entry.getValue();
BindableService rpcService = rpcServerAnnotateConfig.getRpcBean();
List<Class<? extends ServerInterceptor>> interceptors = rpcServerAnnotateConfig.getInterceptors();
if (CollectionUtils.isNotEmpty(interceptors)) {
serverBuilder.addService(ServerInterceptors.intercept(rpcService, listToInstanceArray(interceptors)));
} else {
serverBuilder.addService(rpcService);
}
}

// Set the maximum message that the server can receive(2000M)
serverBuilder.maxInboundMessageSize(2000 * 1024 * 1024);
serverBuilder.compressorRegistry(CompressorRegistry.getDefaultInstance());
serverBuilder.decompressorRegistry(DecompressorRegistry.getDefaultInstance());
serverBuilder.keepAliveTimeout(30, TimeUnit.SECONDS);
// Maximum space time
serverBuilder.maxConnectionIdle(120, TimeUnit.SECONDS);
serverBuilder.maxConnectionAge(120, TimeUnit.SECONDS);
serverBuilder.maxConnectionAgeGrace(180, TimeUnit.SECONDS);
// Start service
rpcServer = serverBuilder.build().start();
// Registration tick
Runtime.getRuntime().addShutdownHook(new Thread(InitRpcServer.this::stop));
// Start daemon
blockUntilShutdown();
```


区块链开发 ficos

https://fisco-bcos-documentation.readthedocs.io/zh_CN/v2.8.0/docs/sdk/java_sdk/quick_start.html?highlight=BcosSDK#configoptionbcossdk
19 changes: 16 additions & 3 deletions 人工智能/区块链/区块链.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ Hyperledger Fabric,是由Linux基金会托管的开源企业级区块链技术
https://help.aliyun.com/product/84950.html


https://github.com/hyperledger/fabric
https://github.com/hyperledger/fabric
fabric是用golang开发的,代码理解起来会容易些


Expand Down Expand Up @@ -74,5 +74,18 @@ https://github.com/FISCO-BCOS/whitepaper
https://fisco-bcos-documentation.readthedocs.io/zh_CN/latest/docs/introduction.html#id3


http://www.fisco-bcos.org/developer/docs/introduction.html
国产的联盟链,资料很全
http://www.fisco-bcos.org/developer/docs/introduction.html
国产的联盟链,资料很全


# 智能合约

https://docs.soliditylang.org/en/v0.6.1/index.html

## 合约案例

https://docs.soliditylang.org/en/v0.6.1/solidity-by-example.html

## 合约语法

https://docs.soliditylang.org/en/v0.6.1/solidity-in-depth.html
Loading

0 comments on commit 02fd0ff

Please sign in to comment.