Human Generated Data

Title

Untitled (man holding baby)
Date

c. 1950, from earlier negative
People

Artist: John Howell, American active 1930s-1960s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21728

Human Generated Data

Title

Untitled (man holding baby)

People

Artist: John Howell, American active 1930s-1960s

Date

c. 1950, from earlier negative

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21728

Machine Generated Data

Tags

Amazon
created on 2022-03-11

Clothing 99.3
Apparel 99.3
Person 98.6
Human 98.6
Person 98.1
Face 93.9
Tie 93.1
Accessories 93.1
Accessory 93.1
Suit 90.3
Overcoat 90.3
Coat 90.3
People 83.1
Shirt 82.7
Female 73.8
Portrait 67.1
Photography 67.1
Photo 67.1
Baby 66
Kid 63.8
Child 63.8
Dress 63.3
Man 60.7
Girl 59.2
Woman 59
Tuxedo 58.5
Floor 57.2

Clarifai
created on 2023-10-22

people 99.8
two 97.2
man 96.7
adult 96
administration 92.7
portrait 92
child 90.7
actor 90.2
group 90
leader 89.8
woman 89.2
family 88.5
wear 88.3
monochrome 87.3
chair 86.4
three 86.2
music 84.8
art 84.2
one 81
medical practitioner 79.4

Imagga
created on 2022-03-11

man 45.7
male 40.1
grandfather 37.6
home 37.5
people 33.5
senior 30.9
couple 29.6
happy 28.8
grandma 28.5
dad 24.8
father 23.5
indoors 22.8
adult 22.8
smiling 22.4
person 21.3
elderly 21.1
portrait 18.1
parent 17.8
family 16.9
men 16.3
husband 16.2
old 16
lifestyle 15.9
smile 15.7
happiness 15.7
sitting 15.5
retirement 15.4
house 15
together 14.9
mature 14.9
room 14.8
camera 14.8
retired 14.5
patient 13.9
inside 13.8
professional 13.7
hospital 13.7
wife 13.3
medical 13.2
office 12.8
worker 12.8
70s 12.8
bow tie 12.7
health 12.5
mother 12.2
cheerful 12.2
looking 12
child 11.3
necktie 11.1
casual 11
love 10.3
indoor 10
interior 9.7
two people 9.7
computer 9.6
married 9.6
standing 9.6
domestic 9.5
illness 9.5
women 9.5
enjoying 9.5
doctor 9.4
face 9.2
human 9
fun 9
kid 8.9
job 8.8
businessman 8.8
half length 8.8
30s 8.7
business 8.5
two 8.5
clothing 8.3
care 8.2
alone 8.2
one 8.2
playing 8.2
pensioner 8.2
dress 8.1
lady 8.1
working 8
seniors 7.9
work 7.8
day 7.8
black 7.8
older 7.8
modern 7.7
nurse 7.6
talking 7.6
joy 7.5
relationship 7.5
clinic 7.4
holding 7.4
teacher 7.1

Google
created on 2022-03-11

Art 80.5
Smile 76.5
Monochrome 70.6
Vintage clothing 70.1
T-shirt 69.9
Monochrome photography 69.8
Curtain 69.1
Sitting 62.9
Room 62.6
Toddler 62.4
Uniform 62.4
Shorts 62.2
Photographic paper 58.9
Photo caption 57.1
Visual arts 56.4
Formal wear 53.9
Paper product 53.1
Retro style 52.7
Child 52.2
Portrait 50.6

Microsoft
created on 2022-03-11

text 99.4
wall 97.8
person 95.5
man 92.3
indoor 89.4
clothing 88.4
human face 83.9
smile 82.5
black and white 63.7
old 53.9
posing 40.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 45-51
Gender Male, 99.7%
Calm 99.9%
Disgusted 0%
Confused 0%
Surprised 0%
Happy 0%
Sad 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 42-50
Gender Male, 99.4%
Calm 90.7%
Sad 6.4%
Surprised 1%
Confused 0.7%
Happy 0.6%
Angry 0.4%
Disgusted 0.2%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Person 98.6%
Person 98.1%
Tie 93.1%

Captions

Microsoft
created on 2022-03-11

an old photo of a man 90%
old photo of a man 89.2%
a man and a woman posing for a photo 67.7%

Text analysis

Amazon

TSJ
KODYK-20VLE1A

Google

KODVK-2.VEEIA
KODVK-2.VEEIA