Human Generated Data

Title

Untitled (kids with Santa Claus, outdoors)
Date

December 1956
People

Artist: Francis J. Sullivan, American 1916 - 1996
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17996

Human Generated Data

Title

Untitled (kids with Santa Claus, outdoors)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

December 1956

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-04

Person 98.9
Human 98.9
Person 97.6
Person 97.6
Person 96.9
Person 96.6
Clothing 95.7
Apparel 95.7
Person 90.5
Person 87.8
Person 80.3
Coat 76
Overcoat 76
Suit 72.6
Face 67.3
Photography 61.6
Photo 61.6
Person 60.4
Musician 57.8
Musical Instrument 57.8
Pedestrian 56.5
Person 45

Imagga
created on 2022-03-04

steel drum 78.6
percussion instrument 64.4
musical instrument 50.3
man 32.9
people 29.5
business 26.1
male 23.4
chair 22.7
barbershop 21.8
work 20.4
men 19.7
shop 19.7
businessman 18.5
office 17
person 16.1
adult 13.9
mercantile establishment 13.5
modern 13.3
hairdresser 13.2
room 12
worker 11.2
sitting 11.2
seller 10.9
lifestyle 10.8
city 10.8
professional 10.8
team 10.7
interior 10.6
job 10.6
working 10.6
indoors 10.5
table 10.4
corporate 10.3
smiling 10.1
occupation 10.1
restaurant 10.1
fashion 9.8
building 9.7
group 9.7
computer 9.6
black 9.6
meeting 9.4
industry 9.4
life 9.1
suit 9
place of business 9
outdoors 9
standing 8.7
light 8.7
mid adult 8.7
salon 8.6
manager 8.4
inside 8.3
seat 8.2
laptop 8.2
businesswoman 8.2
happy 8.1
urban 7.9
architecture 7.8
portrait 7.8
attractive 7.7
furniture 7.6
businesspeople 7.6
career 7.6
floor 7.4
holding 7.4
technology 7.4
teamwork 7.4
safety 7.4
window 7.3
confident 7.3
industrial 7.3
success 7.2
barber chair 7.2
home 7.2
equipment 7.1
medical 7.1
travel 7

Google
created on 2022-03-04

Hat 89
Black-and-white 85.6
Style 83.9
Tree 80.8
Adaptation 79.2
Art 75.9
Monochrome photography 74.5
Monochrome 72.9
Plant 69.9
Room 67.2
Event 66.6
Font 66.4
T-shirt 65
Vintage clothing 64.9
Street 62.8
Visual arts 62.7
History 59.3
Illustration 58.1
Photographic paper 55.8
Sitting 54.3

Microsoft
created on 2022-03-04

person 99.4
clothing 98.2
black and white 97.1
street 91
man 88.6
text 87.9
monochrome 87.2
woman 80.2
tree 59.4

Face analysis

Amazon

Google

AWS Rekognition

Age 26-36
Gender Male, 99.3%
Calm 75.1%
Sad 15.7%
Surprised 3.6%
Disgusted 2%
Confused 1.5%
Angry 0.9%
Happy 0.7%
Fear 0.5%

AWS Rekognition

Age 26-36
Gender Male, 99.8%
Calm 95.9%
Happy 2.4%
Surprised 0.5%
Angry 0.4%
Sad 0.3%
Confused 0.2%
Disgusted 0.2%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%

Captions

Microsoft

a group of people around each other 69.2%
a group of people standing in front of a laptop 51.1%
a group of people standing around a table 51%