Human Generated Data

Title

Couple, Fundraiser for Walter Mondale, San Francisco

Date

1984

People

Artist: Richard Gordon, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of the artist, 2.2002.1838

Human Generated Data

Title

Couple, Fundraiser for Walter Mondale, San Francisco

People

Artist: Richard Gordon, American 20th century

Date

1984

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.3
Human 99.3
Person 98.9
Person 98.4
Person 98.2
Person 95.5
Crowd 93.7
Clothing 90.6
Apparel 90.6
Person 88
Person 87.8
Paparazzi 87.5
Coat 86.4
Suit 86.4
Overcoat 86.4
Suit 78
Press Conference 72.8
Photographer 64.7
Person 57
Person 56.9
Attorney 55.4

Imagga
created on 2021-12-14

man 51
male 43.2
people 35.1
person 33.1
business 31
businessman 30
men 27.5
corporate 24.9
office 23.8
executive 22.7
adult 22.1
portrait 22
senior 21.5
face 21.3
tie 20.9
suit 20.7
handsome 20.5
happy 18.2
old 17.4
black 16.2
professional 15.8
work 15.7
couple 14.8
lifestyle 14.4
looking 14.4
brass 14
mature 13.9
wind instrument 13.9
group 13.7
elderly 13.4
meeting 13.2
manager 13
smiling 13
groom 12.8
businessmen 12.7
spectator 12.6
job 12.4
cornet 12.3
indoor 11.9
happiness 11.7
glasses 11.1
casual 11
communication 10.9
hand 10.6
corporation 10.6
jacket 10.6
indoors 10.5
look 10.5
human 10.5
success 10.5
businesspeople 10.4
adults 10.4
sitting 10.3
shirt 10.3
love 10.2
smile 10
musical instrument 9.9
cheerful 9.7
talk 9.6
desk 9.4
expression 9.4
head 9.2
sax 9.1
team 9
worker 8.9
computer 8.8
conversation 8.7
day 8.6
boss 8.6
grandfather 8.6
serious 8.6
clothing 8.5
entrepreneur 8
standing 7.8
photographer 7.8
retired 7.8
busy 7.7
modern 7.7
attractive 7.7
retirement 7.7
formal 7.6
career 7.6
horizontal 7.5
dark 7.5
holding 7.4
phone 7.4
aged 7.2
working 7.1

Google
created on 2021-12-14

Clothing 98.7
Outerwear 95.1
Shirt 94.3
Coat 91.9
Black-and-white 85.5
Gesture 85.3
Style 83.9
Suit 79.8
Smile 78.9
Monochrome 75.5
Blazer 75.2
Hat 74.9
Monochrome photography 74.7
Snapshot 74.3
Event 74
Formal wear 73.5
Eyewear 72.1
Vintage clothing 69.5
White-collar worker 66.1
Tie 65.9

Microsoft
created on 2021-12-14

person 100
text 98.8
clothing 98.2
musical instrument 97.4
concert 94.1
man 94
guitar 91.9
people 88.5
black and white 82
human face 81.9
group 75.5
crowd 1.1

Face analysis

Amazon

Google

AWS Rekognition

Age 36-52
Gender Male, 97.4%
Calm 74.5%
Happy 13.4%
Surprised 5.1%
Sad 2.5%
Angry 1.8%
Disgusted 1.3%
Confused 1.1%
Fear 0.3%

AWS Rekognition

Age 28-44
Gender Male, 96.1%
Surprised 67.9%
Confused 16.3%
Fear 9.3%
Calm 4.4%
Angry 0.8%
Sad 0.6%
Disgusted 0.5%
Happy 0.2%

AWS Rekognition

Age 20-32
Gender Female, 98.2%
Calm 39.1%
Disgusted 17.9%
Fear 13.9%
Happy 9.4%
Confused 7.3%
Sad 6%
Angry 3.8%
Surprised 2.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Suit 86.4%

Captions

Microsoft

a group of people standing next to a man in a suit and tie 98.1%
a group of people standing in front of a crowd 95.1%
a group of people standing next to a man wearing a suit and tie 95%