Human Generated Data

Title

Untitled (young men and women at table at ball)
Date

1962
People

Artist: Robert Burian, American active 1940s-1950s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19180

Human Generated Data

Title

Untitled (young men and women at table at ball)

People

Artist: Robert Burian, American active 1940s-1950s

Date

1962

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Person 99.5
Human 99.5
Person 99.4
Person 99.3
Person 97.2
Person 96.4
Person 95.7
Person 95
Person 93.5
Pub 85.3
Bar Counter 85.3
Person 78.3
Poster 72.3
Advertisement 72.3
Crowd 66.2
People 65.2
Text 64.6
Screen 60.8
Electronics 60.8
Display 58.3
Monitor 58.3
Room 55.8
Indoors 55.8
Restaurant 55.5
Home Decor 55.2

Imagga
created on 2022-02-25

businessman 45
business 42.5
man 40.3
office 37.2
male 31.9
people 30.7
corporate 29.2
person 27.8
sax 26.7
businesspeople 23.7
adult 23.5
group 23.4
professional 23.1
businesswoman 22.7
happy 22.6
team 21.5
computer 21.1
desk 20.8
meeting 20.7
sitting 20.6
job 20.3
communication 20.1
suit 20.1
work 19.6
indoor 19.2
executive 18.6
colleagues 18.5
corporation 17.4
laptop 16.7
indoors 16.7
men 16.3
manager 15.8
room 15.7
wind instrument 15.4
looking 15.2
working 15
discussion 14.6
web site 14.6
handsome 14.3
smile 14.3
career 14.2
happiness 14.1
couple 13.1
cheerful 13
associates 12.8
boss 12.4
tie 12.3
jacket 12.3
smiling 12.3
company 12.1
teamwork 12
black 12
two 11.9
coworkers 11.8
discussing 11.8
businessmen 11.7
teacher 11.5
together 11.4
table 11.2
brass 10.9
worker 10.7
employee 10.6
staff 10.6
modern 10.5
success 10.5
education 10.4
women 10.3
horizontal 10
cornet 9.9
planner 9.5
mature 9.3
confident 9.1
night 8.9
cooperation 8.7
lifestyle 8.7
formal 8.6
talking 8.6
face 8.5
musical instrument 8.5
casual 8.5
portrait 8.4
technology 8.2
newspaper 8
collaboration 7.9
boy 7.8
conversation 7.8
mid adult 7.7
30s 7.7
attractive 7.7
serious 7.6
hand 7.6
silhouette 7.4
product 7.4
20s 7.3
alone 7.3
bright 7.1

Google
created on 2022-02-25

Coat 87.6
Chair 83.6
Font 82.4
Adaptation 79.3
Suit 77.7
Event 71.6
Photo caption 70.4
Room 69.1
Vintage clothing 67.4
Stock photography 63.1
History 62.8
Sitting 61.4
Art 60.1
Photographic paper 59
Classic 57.9
Visual arts 57.3
Rectangle 57.1
Table 50.5

Microsoft
created on 2022-02-25

text 100
person 97
clothing 95.5
man 84.3
human face 82.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-26
Gender Male, 99.9%
Surprised 78.5%
Calm 8.2%
Happy 5.9%
Fear 4.3%
Disgusted 0.9%
Confused 0.8%
Angry 0.8%
Sad 0.6%

AWS Rekognition

Age 19-27
Gender Male, 99.8%
Calm 97.3%
Angry 1.8%
Sad 0.3%
Confused 0.2%
Happy 0.2%
Fear 0.1%
Surprised 0.1%
Disgusted 0%

AWS Rekognition

Age 23-33
Gender Female, 100%
Happy 99%
Surprised 0.4%
Fear 0.2%
Disgusted 0.1%
Angry 0.1%
Sad 0.1%
Confused 0.1%
Calm 0%

AWS Rekognition

Age 20-28
Gender Female, 99.8%
Disgusted 48.3%
Confused 21.1%
Angry 16.7%
Calm 6.6%
Sad 3.2%
Surprised 1.7%
Happy 1.7%
Fear 0.7%

AWS Rekognition

Age 19-27
Gender Male, 100%
Happy 85.2%
Angry 8.9%
Surprised 2.3%
Confused 1.3%
Calm 1%
Disgusted 0.7%
Fear 0.3%
Sad 0.2%

AWS Rekognition

Age 21-29
Gender Male, 100%
Sad 95.3%
Happy 1.3%
Angry 0.9%
Fear 0.8%
Calm 0.6%
Disgusted 0.4%
Confused 0.4%
Surprised 0.3%

AWS Rekognition

Age 18-26
Gender Female, 100%
Calm 47.1%
Happy 38.7%
Sad 5.7%
Angry 2.8%
Disgusted 1.8%
Surprised 1.6%
Fear 1.2%
Confused 1%

AWS Rekognition

Age 37-45
Gender Male, 88.5%
Happy 31.8%
Disgusted 27.4%
Angry 15.9%
Confused 9.1%
Sad 7%
Surprised 3.9%
Fear 3.5%
Calm 1.5%

AWS Rekognition

Age 20-28
Gender Male, 99.9%
Calm 53.7%
Surprised 12.5%
Happy 9.3%
Angry 9.3%
Disgusted 5.4%
Confused 4.2%
Sad 2.8%
Fear 2.8%

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 18
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 38
Gender Female

Microsoft Cognitive Services

Age 22
Gender Male

Microsoft Cognitive Services

Age 35
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Poster 72.3%

Captions

Microsoft

a group of people standing in front of a television 56.1%
a group of people standing in front of a screen 56%
a group of people watching a screen 55.9%

Text analysis

Amazon

62
DEC
129
129 126
126

Google

2.
62
DEC 62 2.
DEC