Human Generated Data

Title

UAW Convention, Atlantic City

Date

1946

People

Artist: Samuel Shere, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Daniel Bell, P1979.60

Human Generated Data

Title

UAW Convention, Atlantic City

People

Artist: Samuel Shere, American 20th century

Date

1946

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Daniel Bell, P1979.60

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.7
Human 99.7
Person 98.4
Text 85.7
Sitting 82.1
Crowd 70.6
Musician 67.2
Musical Instrument 67.2
Finger 67
Leisure Activities 63.6
Suit 62.4
Clothing 62.4
Coat 62.4
Apparel 62.4
Overcoat 62.4

Clarifai
created on 2023-10-26

people 99.7
man 97.6
administration 95.3
monochrome 95
adult 94.2
one 92.7
portrait 92
leader 89.1
war 87.7
music 87.5
two 87.1
group 86.6
three 84.6
street 82.1
book series 81.8
musician 73.8
wear 73.7
retro 72.8
indoors 72.2
room 71

Imagga
created on 2022-01-23

business 52.3
laptop 49.4
businessman 46.8
office 45.6
man 43.7
computer 42.2
male 39.8
person 36.7
businesswoman 35.5
work 33.8
working 33.6
people 32.9
corporate 31.8
sitting 31.8
desk 30.5
adult 29.8
executive 29.4
meeting 29.2
professional 27.4
table 27
businesspeople 26.6
confident 25.5
suit 25.4
group 24.2
scholar 23.7
manager 23.3
looking 23.2
room 22.8
happy 22.6
communication 21.9
job 21.3
smile 20.7
team 20.6
successful 20.2
worker 19.8
intellectual 19
smiling 18.8
success 18.5
indoor 17.4
notebook 16.9
musical instrument 16.7
teamwork 16.7
women 16.6
technology 16.3
men 16.3
workplace 16.2
talking 16.2
together 15.8
indoors 15
classroom 14.9
director 14.8
colleagues 14.6
handsome 14.3
portrait 14.2
speaker 14
piano 13.9
conversation 13.6
stringed instrument 13.5
career 13.3
lifestyle 13
discussion 12.7
attractive 12.6
corporation 12.6
busy 12.5
formal 12.4
teacher 12.3
expression 12
modern 11.9
wind instrument 11.9
conference 11.7
grand piano 11.5
student 11.5
contemporary 11.3
education 11.3
one 11.2
discussing 10.8
articulator 10.7
employment 10.7
collar 10.6
boss 10.5
keyboard instrument 10.4
percussion instrument 10.3
company 10.2
happiness 10.2
casual 10.2
cheerful 9.8
home 9.6
paper 9.4
mature 9.3
coffee 9.3
occupation 9.2
employee 9
lady 8.9
businessmen 8.8
businessperson 8.8
couple 8.7
planning 8.7
30s 8.7
bassoon 8.6
serious 8.6
face 8.5
two 8.5
glasses 8.3
communicator 8
coworkers 7.9
partners 7.8
oboe 7.8
jacket 7.7
diversity 7.7
entrepreneur 7.7
achievement 7.7
chair 7.7
talk 7.7
wireless 7.6
secretary 7.6
reading 7.6
thinking 7.6
hand 7.6
tie 7.6
sit 7.6
senior 7.5
presentation 7.5
holding 7.4
call 7.4
phone 7.4
alone 7.3
black 7.2
interior 7.1
day 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 98.4
person 97.7
music 91.5
man 90.7
black and white 79.9
black 78.8
clothing 75.7
piano 68.3
handwriting 61
old 51.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 43-51
Gender Male, 100%
Confused 43.4%
Angry 42.9%
Disgusted 8.6%
Fear 1.2%
Surprised 1%
Sad 1%
Calm 1%
Happy 0.9%

AWS Rekognition

Age 26-36
Gender Male, 100%
Calm 77.3%
Sad 8.7%
Angry 4.1%
Confused 3.1%
Disgusted 2.4%
Surprised 1.9%
Happy 1.4%
Fear 1%

AWS Rekognition

Age 43-51
Gender Male, 97.9%
Calm 96.5%
Confused 3.2%
Sad 0.1%
Surprised 0.1%
Angry 0.1%
Disgusted 0%
Happy 0%
Fear 0%

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Suit 62.4%

Captions

Text analysis

Amazon

THOMAS
REUTHER
THOMAS LASHES AT REUTHER
AT
The
LASHES
Splits
Price
BAL
Detroit
Politics
Hike
Living
1
Price Hike Fres
Press
The Detroit Free Press
3 Living
700,000
-
3
. t Politics Splits Leadership
Leadership
Fres
700,000 Suitsord
Free
.
t
a
Suitsord
Y
Cost
Son

Google

The Detroit free Press LAW Politics Splits Lealership THOMAS LASHES AT REUTHER Price Hike Fes 700,000 Suits
The
Detroit
free
Press
LAW
Politics
Splits
Lealership
THOMAS
LASHES
AT
REUTHER
Price
Hike
Fes
700,000
Suits