Human Generated Data

Title

Untitled (newlyweds with suitcases, Brookline, Massachusetts)

Date

1950, printed later

People

Artist: Samuel Cooper, American active 1950s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.948

Human Generated Data

Title

Untitled (newlyweds with suitcases, Brookline, Massachusetts)

People

Artist: Samuel Cooper, American active 1950s

Date

1950, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Tie 98.4
Accessories 98.4
Accessory 98.4
Bag 93
Briefcase 93
Person 92.5
Human 92.5
Person 85.5
Clothing 80.1
Apparel 80.1
Suit 78.3
Coat 78.3
Overcoat 78.3
Couch 68.5
Furniture 68.5

Imagga
created on 2021-12-14

laptop 62.1
office 61.5
computer 57.3
business 56.6
executive 48.2
businessman 47.7
professional 44
corporate 43.9
work 42.4
working 40.7
person 40.3
businesswoman 40
man 38.3
notebook 37.1
businesspeople 37
job 35.4
male 34.1
desk 34
happy 33.2
people 32.9
suit 31.4
adult 30.7
confident 30.1
secretary 28.8
smiling 26.1
sitting 25.8
success 25.8
smile 25.7
handsome 25
looking 24.8
worker 24.4
communication 22.7
meeting 21.7
table 21.7
modern 21.1
men 20.6
manager 20.5
attractive 20.3
successful 20.2
technology 20.1
career 19.9
casual 19.5
colleagues 19.4
portrait 19.4
group 19.4
team 18.8
indoor 18.3
workplace 18.1
friendly 17.4
corporation 17.4
contemporary 16
teamwork 15.8
face 15.6
occupation 15.6
cheerful 15.5
busy 15.4
one 14.9
together 14.9
formal 14.3
groom 14
employee 14
staff 13.4
talking 13.3
portable computer 13.2
company 13
mature 13
positive 12.9
consultant 12.7
tie 12.3
lifestyle 12.3
keyboard 12.2
glasses 12
alone 11.9
associates 11.8
happiness 11.8
horizontal 11.7
call 11.6
indoors 11.4
expression 11.1
women 11.1
20s 11
discussing 10.8
partner 10.6
planning 10.6
leadership 10.6
partnership 10.6
boss 10.5
clothing 10.2
room 10.2
personal computer 10.1
businessmen 9.8
businessperson 9.8
leader 9.6
serious 9.5
smart 9.4
life 9.3
director 9.2
student 8.9
jacket 8.9
25 30 years 8.8
home 8.8
discussion 8.8
employment 8.7
mid adult 8.7
1 8.7
education 8.7
confidence 8.6
finance 8.5
speaker 8.4
coffee 8.3
lawyer 8.3
garment 8.1
colleague 8
black 7.9
teacher 7.9
interaction 7.9
good mood 7.8
typing 7.8
color 7.8
satisfied 7.8
assistant 7.8
pretty 7.7
achievement 7.7
thinking 7.6
relaxed 7.5
camera 7.5
support 7.5
shirt 7.5
inside 7.4
lady 7.3
scholar 7.2
bright 7.2
day 7.1
model 7

Google
created on 2021-12-14

Shoe 94.7
Coat 91.1
Chair 86.4
Style 83.9
Suit 80.1
Blazer 78.1
Picture frame 77
Formal wear 76.4
Classic 75.4
Snapshot 74.3
Vintage clothing 73.5
Tie 72.6
Collar 72.4
Monochrome 70.3
Monochrome photography 68.1
Event 67.8
Room 67.7
Lap 65
Sitting 64.6
Stock photography 63.9

Microsoft
created on 2021-12-14

person 97.5
text 97.2
man 92.2
clothing 87.1
black and white 85.4
suit 83.1
smile 72.7
posing 43

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 32-48
Gender Male, 97.7%
Calm 82.1%
Happy 5.9%
Sad 2.9%
Confused 2.6%
Angry 2.4%
Surprised 1.9%
Disgusted 1.4%
Fear 0.8%

AWS Rekognition

Age 29-45
Gender Female, 99.2%
Happy 61%
Calm 14.3%
Disgusted 9%
Surprised 4.8%
Confused 3.8%
Angry 3.5%
Fear 2.3%
Sad 1.3%

AWS Rekognition

Age 23-37
Gender Female, 64.9%
Calm 32.8%
Happy 25.2%
Sad 12.1%
Fear 11.8%
Surprised 9.1%
Confused 4.2%
Angry 3%
Disgusted 1.7%

Microsoft Cognitive Services

Age 41
Gender Female

Microsoft Cognitive Services

Age 48
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 98.4%
Person 92.5%
Suit 78.3%

Captions

Microsoft

a couple of men standing next to a man in a suit and tie 97.2%
a man in a suit standing in front of a computer 97.1%
a man wearing a suit and tie standing next to a suitcase 93.5%

Text analysis

Amazon

85
58%
58% P96
P96

Google

58% P96
P96
58%