Human Generated Data

Title

General Motors Strike, Detroit

Date

c. 1950

People

Artist: Leo Choplin, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Daniel Bell, P1979.25

Human Generated Data

Title

General Motors Strike, Detroit

People

Artist: Leo Choplin, American 20th century

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Crowd 99.6
Human 99.6
Audience 99.3
Person 99.1
Person 99
Person 98.9
Accessories 98.8
Tie 98.8
Accessory 98.8
Tie 98.6
Sitting 98.4
Speech 94
Person 91.5
Suit 91.4
Apparel 91.4
Overcoat 91.4
Clothing 91.4
Coat 91.4
Press Conference 91.3
Suit 90.2
Tie 82.5
Suit 77.1
Lecture 69.8
Indoors 61.8
Room 57.4

Imagga
created on 2021-12-14

office 59.9
businessman 54.8
business 52.3
businesswoman 49.1
corporate 45.6
meeting 45.3
businesspeople 39.9
man 39
laptop 38.9
professional 38.9
scholar 38
executive 37.6
person 37.1
computer 35.5
people 35.2
colleagues 34
group 33.9
team 33.2
suit 32.8
male 32.7
job 31.9
work 30.6
intellectual 30.4
table 29.6
happy 29.5
teamwork 28.8
adult 27.8
sitting 27.5
communication 26.9
working 26.5
desk 25.7
together 24.6
manager 24.2
men 22.3
notebook 20.3
confident 20
looking 19.2
attractive 18.9
success 18.5
corporation 18.3
indoor 18.3
career 18
discussion 17.5
successful 17.4
smiling 17.4
handsome 17
company 16.8
busy 16.4
smile 16.4
workplace 16.2
modern 16.1
businessmen 15.6
occupation 15.6
20s 15.6
talking 15.2
room 14.4
formal 14.3
discussing 13.8
coworkers 13.8
lifestyle 13.7
partners 13.6
30s 13.5
women 13.5
staff 13.4
employee 13
worker 12.8
jacket 12.7
boss 12.4
secretary 12.3
indoors 12.3
portrait 12.3
presentation 12.1
technology 11.9
two 11.9
25 30 years 11.8
partnership 11.5
tie 11.4
cheerful 11.4
coffee 11.1
casual 11
horizontal 10.9
associates 10.8
businesswomen 10.8
conversation 10.7
employment 10.6
contemporary 10.4
paper 10.2
director 10.1
30 35 years 9.8
businessperson 9.8
partner 9.7
classroom 9.6
document 9.3
face 9.2
alone 9.1
boardroom 8.9
conference 8.8
mid adult 8.7
happiness 8.6
stress 8.6
reading 8.6
expression 8.5
adults 8.5
telephone 8.5
phone 8.3
friendly 8.2
interaction 7.9
couple 7.8
consultant 7.8
paperwork 7.8
cooperation 7.7
pretty 7.7
talk 7.7
thinking 7.6
call 7.5
entrepreneur 7.1
life 7.1
clothing 7

Google
created on 2021-12-14

Coat 92.4
Suit 81.9
Table 75.9
Blazer 75.8
Tie 75.3
White-collar worker 73.5
Event 72.6
Curtain 71.2
Font 70.9
Job 68
Monochrome 67.8
Employment 67.6
History 64.9
Monochrome photography 61.4
Formal wear 61.4
Collaboration 60.9
Management 60.9
Publication 59.1
Room 58.9
Chair 58.7

Microsoft
created on 2021-12-14

person 99.5
clothing 93.9
text 91.4
man 85.1
group 79.7
people 77.6
posing 75.9
black and white 73.1
suit 70.2
handwriting 57.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-56
Gender Male, 99%
Calm 98%
Surprised 0.6%
Confused 0.5%
Angry 0.3%
Happy 0.2%
Sad 0.2%
Disgusted 0.2%
Fear 0%

AWS Rekognition

Age 32-48
Gender Male, 98.6%
Angry 56.2%
Calm 41.6%
Confused 0.8%
Sad 0.7%
Surprised 0.2%
Fear 0.2%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 31-47
Gender Male, 98.6%
Calm 66.5%
Sad 31.6%
Happy 0.5%
Angry 0.4%
Confused 0.3%
Fear 0.3%
Disgusted 0.2%
Surprised 0.1%

AWS Rekognition

Age 22-34
Gender Male, 67.3%
Calm 96.9%
Confused 1%
Sad 0.7%
Surprised 0.5%
Angry 0.4%
Fear 0.2%
Happy 0.1%
Disgusted 0.1%

Microsoft Cognitive Services

Age 55
Gender Male

Microsoft Cognitive Services

Age 34
Gender Female

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Tie 98.8%
Suit 91.4%

Captions

Microsoft

Walter Reuther et al. posing for a photo 96.6%
Walter Reuther et al. sitting at a table posing for a photo 95.8%
Walter Reuther et al. sitting at a table posing for the camera 95.7%

Text analysis

Amazon

GM
OF
1928
FULL
YEAR
PROFITS OF FULL PRODUCTION
PROFITS
30%
PRODUCTION
HER
INCREASE
1946
WITH 30%
WAGE
OUTPUT
MOST
WITH
STOCKHOLDERS
ROFITABLE
450,000,000
CARS
M's MOST
0,000
M's
RR
. 450,000,000
ООО
.
OFITS
0,000,000

Google

STOCKHOLDERS
ROFITS
OUTPUT
PROFITS OF FULL PRODUCTION 1928 MS MOST ROFITABLE YEAR 1946 WITH 30% WAGE INCREASE STOCKHOLDERS 3,000,000 PROFITS $450,000p00 ROFITS GM p.000 boo CARS 定 HER OUTPUT
INCREASE
3,000,000
$450,000p00
HER
FULL
MS
30%
WAGE
PROFITS
GM
boo
CARS
OF
1928
YEAR
PRODUCTION
MOST
ROFITABLE
1946
WITH
p.000