Human Generated Data

Title

Untitled (man standing at table during fancy dinner party)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16335

Human Generated Data

Title

Untitled (man standing at table during fancy dinner party)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Human 99.2
Person 99.2
Person 99.1
Person 98.6
Person 98.3
Person 98
Plant 96.6
Interior Design 95.3
Indoors 95.3
Clothing 95.2
Apparel 95.2
Room 94.6
Flower 91.4
Blossom 91.4
Flower Arrangement 89.1
Coat 88.5
Suit 88.5
Overcoat 88.5
Sitting 83.5
Flower Bouquet 82.2
Person 78.3
Furniture 67
Photography 63.2
Photo 63.2
Person 63.2
Portrait 61
Face 61
Tuxedo 59.9
People 59.4
Dress 57.6
Living Room 57.2
Vase 56.9
Pottery 56.9
Jar 56.9
Chair 56.8
Person 42.4

Imagga
created on 2022-02-11

person 37
senior 35.6
man 34.9
people 34
male 29.8
adult 27.4
elderly 26.8
happy 26.3
couple 26.1
mature 26
home 22.3
old 22.3
smiling 21.7
patient 21.2
indoors 21.1
sitting 18.9
men 18.9
looking 18.4
medical 17.6
portrait 17.5
women 17.4
lifestyle 17.3
room 16.6
happiness 16.4
retirement 16.3
cheerful 16.2
husband 16.2
grandma 15.5
grandfather 14.7
professional 14.1
retired 13.6
smile 13.5
family 13.3
work 13.3
hospital 13.3
wife 13.3
health 13.2
care 13.2
together 13.1
lady 13
table 13
office 12.8
human 12.7
two 12.7
musical instrument 12.7
love 12.6
worker 12.4
hair 11.9
executive 11.9
indoor 11.9
aged 11.8
older 11.6
handsome 11.6
businessman 11.5
businesspeople 11.4
doctor 11.3
modern 11.2
laptop 10.9
bassoon 10.7
wind instrument 10.7
groom 10.6
mother 10.5
pretty 10.5
group 10.5
age 10.5
computer 10.4
meeting 10.4
pensioner 10.3
face 9.9
kin 9.9
holding 9.9
hand 9.9
nurse 9.9
60s 9.8
teacher 9.8
business 9.7
look 9.6
married 9.6
education 9.5
talking 9.5
casual 9.3
bowed stringed instrument 9.3
occupation 9.2
clothing 9.1
attractive 9.1
gray 9
clinic 8.9
job 8.8
working 8.8
two people 8.7
drinking 8.6
violin 8.6
desk 8.5
help 8.4
company 8.4
drink 8.3
teamwork 8.3
student 8.2
businesswoman 8.2
stringed instrument 8.1
case 8
to 8
sick person 7.9
70s 7.9
grandmother 7.8
brass 7.8
chair 7.7
illness 7.6
marriage 7.6
enjoying 7.6
friends 7.5
fun 7.5
leisure 7.5
alone 7.3
suit 7.2
celebration 7.2
team 7.2
romance 7.1
romantic 7.1
day 7.1
medicine 7

Google
created on 2022-02-11

Microsoft
created on 2022-02-11

person 92.1
window 91.6
wedding dress 90.2
indoor 88.8
bride 79.1
vase 75.7
text 69.2
candle 62.5
wedding 58
old 47.3
posing 39.7

Face analysis

Amazon

Google

AWS Rekognition

Age 50-58
Gender Male, 99.8%
Calm 85.9%
Sad 13.2%
Confused 0.5%
Surprised 0.2%
Angry 0.1%
Disgusted 0.1%
Fear 0%
Happy 0%

AWS Rekognition

Age 43-51
Gender Male, 61.4%
Happy 91.6%
Surprised 7.2%
Calm 0.5%
Angry 0.2%
Fear 0.2%
Confused 0.1%
Disgusted 0.1%
Sad 0.1%

AWS Rekognition

Age 39-47
Gender Male, 99.9%
Happy 75.7%
Calm 6.8%
Confused 6.5%
Surprised 3.5%
Disgusted 3.1%
Angry 2.1%
Fear 1.6%
Sad 0.8%

AWS Rekognition

Age 29-39
Gender Male, 93.5%
Calm 50.8%
Confused 22.1%
Fear 6.2%
Sad 5.7%
Happy 5%
Angry 4.4%
Disgusted 3%
Surprised 2.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a group of people standing in front of a mirror posing for the camera 90.7%
a group of people sitting in front of a mirror posing for the camera 88%
a group of people in front of a mirror posing for the camera 87.9%

Text analysis

Amazon

18.
KODVK-
KODVK- 2VEETA
2VEETA

Google

18.
18.