Human Generated Data

Title

Untitled (eight students working on typewriters in classroom)

Date

1952

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9398

Human Generated Data

Title

Untitled (eight students working on typewriters in classroom)

People

Artist: Martin Schweig, American 20th century

Date

1952

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.1
Human 99.1
Person 98.8
Person 98.7
Person 98.1
Person 97.6
Person 97.3
Person 96.7
Chair 94.5
Furniture 94.5
Person 92.3
Clinic 80.6
Sitting 76.2
Indoors 69.6
Building 69.5
People 69.3
Room 63.2
Court 58.8
Cafeteria 58.2
Restaurant 58.2
Crowd 57.9

Imagga
created on 2022-01-23

man 42.3
businessman 41.5
office 38.9
male 38.3
business 38.3
people 37.9
person 37.4
meeting 35.8
room 35.2
group 32.2
table 32.2
professional 31.4
team 31.4
teacher 29.8
classroom 29.4
adult 28.6
sitting 28.3
men 28.3
businesswoman 25.5
businesspeople 24.7
smiling 24.6
desk 23.8
colleagues 23.3
work 22.8
happy 22.6
corporate 22.3
communication 21.8
executive 21.6
women 21.4
teamwork 21.3
talking 20
laptop 19.7
working 19.4
indoors 18.4
together 18.4
educator 18.1
discussion 16.6
computer 16.1
manager 15.8
couple 15.7
indoor 15.5
suit 15.3
student 14.8
education 14.7
worker 14.6
cheerful 14.6
job 14.2
successful 13.7
conference 13.7
confident 13.6
modern 13.3
smile 12.8
coworkers 12.8
happiness 12.5
life 12.4
lifestyle 12.3
associates 11.8
discussing 11.8
partners 11.7
interior 11.5
chair 11.5
hall 11.5
success 11.3
employee 11.2
looking 11.2
presentation 11.2
mature 11.2
portrait 11
restaurant 11
workplace 10.5
friends 10.3
board 9.9
corporation 9.7
technology 9.6
musical instrument 9.6
four 9.6
company 9.3
20s 9.2
handsome 8.9
collaboration 8.9
home 8.8
cooperation 8.7
diversity 8.6
drinking 8.6
ethnic 8.6
center 8.5
career 8.5
casual 8.5
horizontal 8.4
school 8.3
new 8.1
entrepreneur 7.9
businessmen 7.8
color 7.8
mid adult 7.7
busy 7.7
class 7.7
30s 7.7
collar 7.7
hand 7.6
adults 7.6
plan 7.6
learning 7.5
showing 7.5
senior 7.5
holding 7.4
wine 7.4
day 7.1
glass 7

Google
created on 2022-01-23

Coat 92.4
Table 86.4
Suit 80.8
Chair 78.9
Desk 75
Font 73
Monochrome photography 72.8
Monochrome 72.2
Event 71.6
Room 69.4
Job 65.4
Sitting 64.7
History 64.1
Team 63.3
Employment 62.3
Class 59.7
Collaboration 59.6
Conversation 58.9
Office equipment 58.1
White-collar worker 56

Microsoft
created on 2022-01-23

text 99.6
person 95.4
clothing 91.4
table 88.6
man 79.2
group 57.1
several 10.4

Face analysis

Amazon

Google

AWS Rekognition

Age 26-36
Gender Female, 99.6%
Calm 60.7%
Sad 33%
Surprised 4.3%
Fear 1.3%
Angry 0.3%
Disgusted 0.2%
Confused 0.2%
Happy 0.1%

AWS Rekognition

Age 28-38
Gender Male, 95.1%
Calm 98%
Sad 1.3%
Happy 0.3%
Surprised 0.1%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 23-31
Gender Female, 82.1%
Sad 63.6%
Calm 33.2%
Surprised 0.7%
Confused 0.7%
Disgusted 0.7%
Angry 0.5%
Fear 0.4%
Happy 0.2%

AWS Rekognition

Age 27-37
Gender Male, 89.4%
Calm 99.9%
Sad 0.1%
Confused 0%
Fear 0%
Surprised 0%
Disgusted 0%
Happy 0%
Angry 0%

AWS Rekognition

Age 28-38
Gender Male, 50.2%
Calm 99.8%
Happy 0.1%
Sad 0%
Confused 0%
Surprised 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 42-50
Gender Male, 90.9%
Calm 79.1%
Sad 19.6%
Happy 0.3%
Confused 0.3%
Angry 0.2%
Disgusted 0.2%
Surprised 0.2%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Chair 94.5%

Captions

Microsoft

a group of people standing around a table 89.4%
a group of people posing for a photo 80%
a group of people standing in front of a table 79.9%

Text analysis

Amazon

ROYAL
SPACE
SPACE BAR
KEY
BAR
WORLD'S
WORLD'S NO.1 TYPENSITES
@@@@@@@@@@
LAUFS
03000000000
NO.1 TYPENSITES
0696668

Google

Q0000000000
2000000000
ROYAL 6000000000 Q0000000000 A0000000000 O 2000000000 e SPACE BAR ACO
6000000000
e
A0000000000
O
SPACE
BAR
ACO
ROYAL