Human Generated Data

Title

Untitled (couple sitting with champagne on a bench in front of the sea)
Date

c. 1970
People

Artist: Ken Whitmire Associates, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1368

Human Generated Data

Title

Untitled (couple sitting with champagne on a bench in front of the sea)

People

Artist: Ken Whitmire Associates, American

Date

c. 1970

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.4
Human 99.4
Apparel 98.5
Clothing 98.5
Person 97.4
Coat 93.7
Suit 93.7
Overcoat 93.7
Sitting 81
Accessories 74.3
Accessory 74.3
Tie 74.3
Furniture 66.1
Couch 65.1
Hand 64.5
Home Decor 62.7
Sleeve 57.3
Dating 55.4

Imagga
created on 2022-01-22

senior 48.8
male 45.4
man 44.4
grandma 43.7
person 39.9
people 39.6
executive 37.5
elderly 31.6
couple 30.5
home 27.9
mature 27
happy 27
adult 26.5
businessman 25.6
secretary 24.7
business 23.7
office 23.3
men 23.2
retired 22.3
old 22.3
indoors 22
professional 21.9
suit 20.8
sitting 20.6
portrait 20.1
smile 20
grandfather 19.4
meeting 18.9
smiling 18.8
husband 16.4
retirement 16.3
handsome 16.1
health 16
together 15.8
happiness 15.7
care 15.6
looking 15.2
worker 15.2
lifestyle 15.2
standing 14.8
cheerful 14.6
corporate 14.6
older 14.6
wife 14.2
medical 14.1
help 14
women 13.5
businesspeople 13.3
tie 13.3
occupation 12.8
indoor 12.8
businesswoman 12.7
aged 12.7
work 12.6
illness 12.4
manager 12.1
group 12.1
human 12
room 11.9
colleagues 11.7
team 11.7
family 11.6
job 11.5
face 11.4
pensioner 11
discussing 10.8
60s 10.8
middle aged 10.7
two people 10.7
patient 10.7
to 10.6
working 10.6
30s 10.6
married 10.6
two 10.2
mother 9.8
partner 9.7
success 9.7
leadership 9.6
formal 9.6
table 9.5
talking 9.5
love 9.5
desk 9.5
glasses 9.3
alone 9.1
nurse 8.8
businessmen 8.8
ill 8.8
partnership 8.7
teacher 8.6
expression 8.5
groom 8.5
hospital 8.5
doctor 8.5
communication 8.4
teamwork 8.4
confident 8.2
planner 8
citizen 7.9
70s 7.9
consultant 7.8
discussion 7.8
check 7.7
corporation 7.7
busy 7.7
modern 7.7
exam 7.7
boss 7.7
loving 7.6
casual 7.6
workplace 7.6
age 7.6
hand 7.6
career 7.6
shirt 7.5
company 7.4
holding 7.4
camera 7.4
active 7.4
lady 7.3
computer 7.2
hair 7.1

Google
created on 2022-01-22

Glasses 97.6
Gesture 85.3
Adaptation 79.4
Tie 78
Blazer 78
Eyewear 75.2
Happy 75.1
Snapshot 74.3
Rectangle 74.1
Formal wear 74.1
Vintage clothing 73.9
Event 72.7
Sitting 70
Fun 68.8
Stock photography 65.6
White-collar worker 63.3
Room 63
Conversation 61.3
Pattern 58.9
Portrait 52.7

Microsoft
created on 2022-01-22

person 100
sitting 99.1
clothing 96.8
man 90.4
smile 87.9
human face 81.5
text 79
woman 63.8
drinking 49

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 54-62
Gender Female, 86%
Happy 97.8%
Angry 0.4%
Surprised 0.4%
Disgusted 0.4%
Calm 0.3%
Confused 0.3%
Fear 0.3%
Sad 0.2%

AWS Rekognition

Age 47-53
Gender Male, 99.2%
Happy 59.9%
Angry 21%
Calm 11%
Sad 2.2%
Fear 1.8%
Disgusted 1.6%
Surprised 1.4%
Confused 1.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Suit 93.7%
Tie 74.3%

Captions

Microsoft

a man and a woman sitting on a bench 87.6%
a man and woman sitting on a bench 86.3%
a man and woman sitting on a bench next to a glass of wine 69.6%