在扩展文本字符串中查找特定单词并开发 SAS 变量

检测文本变量中的单词并创建二进制指示符

带有条件语句的 SAS 数据步骤方法

/* Step 1: Define the dataset */
data test;
    length Status $175;
    infile datalines dsd dlm="|" truncover;
    input ID Status $;
datalines;
1|This is example text I am using instead of real data. I am making the length of this text longer to mimic the long text strings of my data AB/CD
2|This is example AB/CD text I am using instead of real data. I am making the length of this text longer to mimic the long text strings of my data
3|This is example text I am using instead of real data. I AB/CD am making the length of this text longer to mimic the long text strings of my data
4|This is example text I am using instead of real data. I am making the length of this text longer to mimic the long text strings of my data
5|This is example text I am using instead of real data. I am making the length of this text longer to mimic the long text strings of my data
6|This is example text I am using instead of real data. I am making the length of this text longer to AB/CD mimic the long text strings of my data
;
run;

/* Step 2: Create a binary variable based on the presence of "AB/CD" */
data test_with_flag;
    set test;
    ABCD_present = (index(Status, "AB/CD") > 0);
run;

/* Step 3: Display the results */
proc print data=test_with_flag;
run;

处理数据中的长文本并检测模式

使用 Case 语句的 SAS SQL 方法

/* Step 1: Define the dataset */
proc sql;
    create table test as
    select 1 as ID, "This is example text I am using instead of real data. I am making the length of this text longer to mimic the long text strings of my data AB/CD" as Status length=175
    union all
    select 2, "This is example AB/CD text I am using instead of real data. I am making the length of this text longer to mimic the long text strings of my data"
    union all
    select 3, "This is example text I am using instead of real data. I AB/CD am making the length of this text longer to mimic the long text strings of my data"
    union all
    select 4, "This is example text I am using instead of real data. I am making the length of this text longer to mimic the long text strings of my data"
    union all
    select 5, "This is example text I am using instead of real data. I am making the length of this text longer to mimic the long text strings of my data"
    union all
    select 6, "This is example text I am using instead of real data. I am making the length of this text longer to AB/CD mimic the long text strings of my data";

/* Step 2: Add a flag for presence of "AB/CD" */
    create table test_with_flag as
    select ID,
           Status,
           case when find(Status, "AB/CD") > 0 then 1 else 0 end as ABCD_present
    from test;
quit;

长文本中的动态单词检测

使用 pandas 进行文本处理的 Python 方法

# Step 1: Import necessary libraries
import pandas as pd

# Step 2: Define the dataset
data = {
    "ID": [1, 2, 3, 4, 5, 6],
    "Status": [
        "This is example text I am using instead of real data. I am making the length of this text longer to mimic the long text strings of my data AB/CD",
        "This is example AB/CD text I am using instead of real data. I am making the length of this text longer to mimic the long text strings of my data",
        "This is example text I am using instead of real data. I AB/CD am making the length of this text longer to mimic the long text strings of my data",
        "This is example text I am using instead of real data. I am making the length of this text longer to mimic the long text strings of my data",
        "This is example text I am using instead of real data. I am making the length of this text longer to mimic the long text strings of my data",
        "This is example text I am using instead of real data. I am making the length of this text longer to AB/CD mimic the long text strings of my data"
    ]
}
df = pd.DataFrame(data)

# Step 3: Add a binary variable for "AB/CD"
df["ABCD_present"] = df["Status"].str.contains("AB/CD").astype(int)

# Step 4: Display the results
print(df)

有关 SAS 中文本检测的常见问题

1. 如何使 SAS 中的检测不区分大小写？
2. 使用 UPCASE 或者 LOWCASE 使用前对文本进行标准化的功能 INDEX 或者 FIND。
3. 我可以同时搜索多个关键字吗？
4. 是的，使用 PRXMATCH SAS 中的函数或 re.search Python 中处理多种模式的方法。
5. 有什么区别 INDEX 和 FIND 在SAS？
6. INDEX 更简单，但缺乏高级选项，例如区分大小写， FIND 提供。
7. 如何在 Python 中处理极长的文本？
8. 使用 chunking 使用 pandas 或迭代器来处理较小片段的文本的方法。
9. 有没有办法验证关键字检测的结果？
10. 是的，运行交叉验证检查或创建一个小型测试数据集以确保您的标志变量符合预期。

文本检测的要点

检测长文本字符串中的单词需要正确的工具和技术。使用 SAS、SQL 或 Python 可确保灵活地应对各种挑战，例如区分大小写或较大数据集的性能。 😊 通过应用索引和动态文本分析，我们可以简化数据准备。

除了检测之外，模式匹配等高级方法还可以增强文本分析。这些解决方案有助于轻松管理可变性和扩展。无论是处理客户评论还是分析调查数据，这些技术都可以帮助您找到有价值的见解并做出更好的决策。 🚀