Human Generated Data

Title

Untitled (man standing at table during fancy dinner party)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16335

Human Generated Data

Title

Untitled (man standing at table during fancy dinner party)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16335

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Person 99.2
Human 99.2
Person 99.1
Person 98.6
Person 98.3
Person 98
Plant 96.6
Interior Design 95.3
Indoors 95.3
Clothing 95.2
Apparel 95.2
Room 94.6
Flower 91.4
Blossom 91.4
Flower Arrangement 89.1
Suit 88.5
Overcoat 88.5
Coat 88.5
Sitting 83.5
Flower Bouquet 82.2
Person 78.3
Furniture 67
Photography 63.2
Photo 63.2
Person 63.2
Portrait 61
Face 61
Tuxedo 59.9
People 59.4
Dress 57.6
Living Room 57.2
Vase 56.9
Pottery 56.9
Jar 56.9
Chair 56.8
Person 42.4

Clarifai
created on 2023-10-28

people 99.8
group 98.5
music 98
woman 97.2
adult 97.2
musician 96.8
man 96.3
child 95.9
two 94.1
indoors 94
family 92.9
instrument 92.4
group together 91.7
three 91.5
wear 88.7
four 88.1
monochrome 87.6
sibling 87.4
wedding 87.1
room 86.4

Imagga
created on 2022-02-11

person 37
senior 35.6
man 34.9
people 34
male 29.8
adult 27.4
elderly 26.8
happy 26.3
couple 26.1
mature 26
home 22.3
old 22.3
smiling 21.7
patient 21.2
indoors 21.1
sitting 18.9
men 18.9
looking 18.4
medical 17.6
portrait 17.5
women 17.4
lifestyle 17.3
room 16.6
happiness 16.4
retirement 16.3
cheerful 16.2
husband 16.2
grandma 15.5
grandfather 14.7
professional 14.1
retired 13.6
smile 13.5
family 13.3
work 13.3
hospital 13.3
wife 13.3
health 13.2
care 13.2
together 13.1
lady 13
table 13
office 12.8
human 12.7
two 12.7
musical instrument 12.7
love 12.6
worker 12.4
hair 11.9
executive 11.9
indoor 11.9
aged 11.8
older 11.6
handsome 11.6
businessman 11.5
businesspeople 11.4
doctor 11.3
modern 11.2
laptop 10.9
bassoon 10.7
wind instrument 10.7
groom 10.6
mother 10.5
pretty 10.5
group 10.5
age 10.5
computer 10.4
meeting 10.4
pensioner 10.3
face 9.9
kin 9.9
holding 9.9
hand 9.9
nurse 9.9
60s 9.8
teacher 9.8
business 9.7
look 9.6
married 9.6
education 9.5
talking 9.5
casual 9.3
bowed stringed instrument 9.3
occupation 9.2
clothing 9.1
attractive 9.1
gray 9
clinic 8.9
job 8.8
working 8.8
two people 8.7
drinking 8.6
violin 8.6
desk 8.5
help 8.4
company 8.4
drink 8.3
teamwork 8.3
student 8.2
businesswoman 8.2
stringed instrument 8.1
case 8
to 8
sick person 7.9
70s 7.9
grandmother 7.8
brass 7.8
chair 7.7
illness 7.6
marriage 7.6
enjoying 7.6
friends 7.5
fun 7.5
leisure 7.5
alone 7.3
suit 7.2
celebration 7.2
team 7.2
romance 7.1
romantic 7.1
day 7.1
medicine 7

Google
created on 2022-02-11

Photograph 94.1
Black 89.5
Plant 89.5
Black-and-white 86.8
Picture frame 86.3
Style 84
Monochrome 79.8
Monochrome photography 77.8
Saxophonist 73
Event 72.6
Room 71.2
Tie 66.6
Stock photography 63.8
Still life photography 63.3
Vintage clothing 63.2
Woodwind instrument 59.5
House 57.3
Suit 55
Music 52.8

Microsoft
created on 2022-02-11

person 92.1
window 91.6
wedding dress 90.2
indoor 88.8
bride 79.1
vase 75.7
text 69.2
candle 62.5
wedding 58
old 47.3
posing 39.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 50-58
Gender Male, 99.8%
Calm 85.9%
Sad 13.2%
Confused 0.5%
Surprised 0.2%
Angry 0.1%
Disgusted 0.1%
Fear 0%
Happy 0%

AWS Rekognition

Age 43-51
Gender Male, 61.4%
Happy 91.6%
Surprised 7.2%
Calm 0.5%
Angry 0.2%
Fear 0.2%
Confused 0.1%
Disgusted 0.1%
Sad 0.1%

AWS Rekognition

Age 39-47
Gender Male, 99.9%
Happy 75.7%
Calm 6.8%
Confused 6.5%
Surprised 3.5%
Disgusted 3.1%
Angry 2.1%
Fear 1.6%
Sad 0.8%

AWS Rekognition

Age 29-39
Gender Male, 93.5%
Calm 50.8%
Confused 22.1%
Fear 6.2%
Sad 5.7%
Happy 5%
Angry 4.4%
Disgusted 3%
Surprised 2.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.2%
Person 99.1%
Person 98.6%
Person 98.3%
Person 98%
Person 78.3%
Person 63.2%
Person 42.4%

Categories

Imagga

interior objects 96.4%
streetview architecture 2.2%
paintings art 1.1%

Text analysis

Amazon

18.
KODVK-
KODVK- 2VEETA
2VEETA

Google

18.
18.