Human Generated Data

Title

Untitled (people sharing a toast, dressed in formal attire)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16365

Human Generated Data

Title

Untitled (people sharing a toast, dressed in formal attire)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Person 99.1
Human 99.1
Person 99
Person 98.8
Tie 97.6
Accessories 97.6
Accessory 97.6
Clothing 96.6
Apparel 96.6
Helmet 96.6
Person 94.7
Sunglasses 94.5
Clinic 87.6
Female 67.4
Person 67.2
Fashion 63.3
Robe 63.3
Gown 63.3
Evening Dress 63.3
Photography 60.8
Photo 60.8
Finger 57.8

Imagga
created on 2022-02-11

man 39.6
people 35.1
male 32.6
person 29.7
brass 26.8
wind instrument 24.1
men 22.3
musical instrument 20.6
adult 18.2
professional 17.8
couple 15.7
happy 15.6
business 14.6
work 14.1
businessman 14.1
trombone 13.9
group 13.7
worker 13.5
happiness 13.3
groom 12.8
bride 12.5
job 12.4
smiling 12.3
occupation 11.9
women 11.8
love 11.8
life 11.3
wedding 11
portrait 11
lifestyle 10.8
medical 10.6
cornet 10.6
building 10.5
black 10.2
dress 9.9
modern 9.8
office 9.6
together 9.6
hands 9.5
clothing 9.5
room 9.3
elegance 9.2
suit 9.1
attractive 9.1
old 9
handsome 8.9
home 8.8
singer 8.7
married 8.6
musician 8.6
industry 8.5
two 8.5
hand 8.3
uniform 8.3
human 8.2
team 8.1
helmet 8
family 8
indoors 7.9
microphone 7.9
standing 7.8
education 7.8
party 7.7
corporate 7.7
husband 7.6
casual 7.6
nurse 7.6
attendant 7.6
wife 7.6
patient 7.5
fashion 7.5
fun 7.5
teamwork 7.4
success 7.2
face 7.1

Google
created on 2022-02-11

Black-and-white 84.1
Style 83.8
Hat 82.8
Smile 81.2
Eyewear 75.3
Formal wear 74.1
Event 73.3
Monochrome photography 72.6
Fashion design 72.1
Monochrome 71.1
Vintage clothing 71
Art 69.6
Flash photography 67
Room 62.9
Suit 60.8
Classic 60.4
Fun 60.1
History 57.9
Wedding 56.3
Ceremony 52.3

Microsoft
created on 2022-02-11

person 94.6
clothing 90.6
dress 83.9
woman 82.3
text 74.9
wedding dress 60.1
black and white 53.7
man 53.2

Face analysis

Amazon

Google

AWS Rekognition

Age 54-62
Gender Male, 84.1%
Calm 99.9%
Sad 0%
Surprised 0%
Confused 0%
Disgusted 0%
Happy 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 38-46
Gender Female, 96.9%
Happy 87.3%
Sad 3.3%
Calm 3.2%
Confused 1.6%
Fear 1.4%
Surprised 1.4%
Disgusted 1.2%
Angry 0.7%

AWS Rekognition

Age 23-33
Gender Male, 98.6%
Happy 70.3%
Calm 11.2%
Surprised 10.2%
Confused 3%
Angry 1.7%
Sad 1.5%
Disgusted 1.1%
Fear 1%

AWS Rekognition

Age 28-38
Gender Male, 99.6%
Happy 94.7%
Surprised 3.5%
Calm 1.3%
Confused 0.1%
Sad 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Tie 97.6%
Helmet 96.6%
Sunglasses 94.5%

Captions

Microsoft

a group of people posing for a photo 91.1%
a group of people wearing costumes 88.8%
a group of people posing for the camera 88.7%

Text analysis

Amazon

32
ass

Google

32
32