Human Generated Data

Title

Untitled (two businessmen laughing together in office)

Date

1952, printed later

People

Artist: Jean Raeburn, American active 1950s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.131

Human Generated Data

Title

Untitled (two businessmen laughing together in office)

People

Artist: Jean Raeburn, American active 1950s

Date

1952, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Apparel 99.5
Clothing 99.5
Overcoat 98.2
Coat 98.2
Person 98.1
Human 98.1
Person 94.2
Sitting 91.7
Furniture 89.1
Accessory 88.1
Tie 88.1
Accessories 88.1
Tuxedo 84.4
Tie 82.6
Suit 79.5
Table 77.7
Audience 77.2
Crowd 77.2
Suit 74.2
Building 71.2
Office Building 71.2
Desk 66.8
Portrait 65.2
Face 65.2
Photo 65.2
Photography 65.2
Flooring 59.8
Blazer 59.2
Jacket 59.2
Robe 57.3
Fashion 57.3
Speech 55.4

Imagga
created on 2022-01-23

businessman 56.5
office 55.7
business 51.6
man 46.4
male 41.2
professional 40
corporate 39.5
executive 37
adult 35.3
people 35.2
person 35
work 33
laptop 32.1
businesswoman 31.8
suit 31.5
businesspeople 31.3
meeting 31.1
computer 30.5
men 30.1
team 28.7
happy 26.3
handsome 25.9
job 25.7
scholar 25.3
manager 25.2
worker 25
desk 24.8
teamwork 24.1
group 22.6
working 22.1
building 21.8
intellectual 20.2
communication 20.2
success 20.1
formal 20.1
company 19.5
sitting 18.9
table 18.3
modern 17.5
attractive 17.5
confident 17.3
colleagues 16.5
indoor 16.4
corporation 16.4
portrait 16.2
casual 16.1
looking 16
lifestyle 15.9
successful 15.6
boss 15.3
smiling 15.2
clothing 15
jacket 15
library 14.7
discussion 14.6
talking 14.3
face 14.2
together 14
occupation 13.8
20s 13.8
businessmen 13.7
leadership 13.5
notebook 13.3
career 13.3
smile 12.8
room 12.8
workplace 12.4
military uniform 12
technology 11.9
employee 11.6
agreement 10.7
cooperation 10.6
partnership 10.6
indoors 10.5
serious 10.5
ethnic 10.5
tie 10.4
education 10.4
smart 10.4
senior 10.3
mature 10.2
uniform 10.2
student 10.1
alone 10
staff 9.9
25 30 years 9.8
conference 9.8
cheerful 9.8
businessperson 9.8
newspaper 9.7
employment 9.7
partner 9.7
busy 9.6
leader 9.6
wireless 9.5
happiness 9.4
expression 9.4
university 9.3
horizontal 9.2
pretty 9.1
conversation 8.7
couple 8.7
mid adult 8.7
30s 8.7
paper 8.6
structure 8.6
black 8.5
two 8.5
finance 8.4
color 8.3
glasses 8.3
women 7.9
businesswomen 7.9
handshake 7.8
standing 7.8
necktie 7.8
1 7.7
planning 7.7
diversity 7.7
studying 7.7
college 7.6
human 7.5
one 7.5
home 7.2
day 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

person 99.5
suit 99
text 98.4
clothing 97.6
man 94.9
smile 79.6
old 75.1
black 66.9
white 63.8
posing 46.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 51-59
Gender Male, 99.9%
Happy 97.4%
Angry 0.7%
Surprised 0.6%
Disgusted 0.6%
Fear 0.3%
Sad 0.2%
Confused 0.2%
Calm 0%

AWS Rekognition

Age 49-57
Gender Male, 99.7%
Happy 40.3%
Sad 23.9%
Disgusted 14.7%
Angry 8%
Calm 6.6%
Fear 3.1%
Surprised 2.4%
Confused 0.9%

Microsoft Cognitive Services

Age 58
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.1%
Tie 88.1%
Suit 79.5%

Captions

Microsoft

an old photo of a person in a suit and tie 98.2%
old photo of a person in a suit and tie 97.6%
an old photo of a man and woman posing for a picture 82.9%

Text analysis

Amazon

STORIES
MOUNTAIN
EMPRE
Post
POST STORIES
ROOKY MOUNTAIN EMPRE
POST
Post SIORIES
ROOKY
SIORIES
MIRRITA

Google

PosT
STORIES
PosT STORIES IES
IES