Human Generated Data

Title

Untitled (children around table at birthday party)
Date

1948
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2803

Human Generated Data

Title

Untitled (children around table at birthday party)

People

Artist: Harry Annas, American 1897 - 1980

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-16

Person 99.7
Human 99.7
Person 99.5
Person 99.5
Person 99.3
Person 97.6
Chair 96.5
Furniture 96.5
Person 95.1
Clothing 94.5
Apparel 94.5
Plant 90
Face 88.6
Person 88.5
Indoors 88.3
Room 88.3
Female 86.3
Kid 83.2
Child 83.2
Tree 82.6
Classroom 81.3
School 81.3
Person 75.3
Living Room 75
Girl 74.8
Person 74.1
Potted Plant 73.2
Vase 73.2
Pottery 73.2
Jar 73.2
Person 73.2
Person 73
Crowd 68.2
Person 67.5
Person 66.6
Portrait 66.1
Photography 66.1
Photo 66.1
Housing 65.2
Building 65.2
Window 64.5
Urban 64.1
Leisure Activities 63.5
People 63
Hair 62.6
City 61.2
Town 61.2
Play 59.8
Table 59.1
Door 59.1
Boy 57.4
Dining Table 57.1
Monitor 56.5
Electronics 56.5
Screen 56.5
Display 56.5
Christmas Tree 55.5
Ornament 55.5
Road 55
Person 53.6
Person 52.8
Person 50.5

Imagga
created on 2022-01-16

interior 23
home 20.7
equipment 20.2
house 19.2
backboard 18.5
dishwasher 17.2
balcony 16.8
modern 16.8
room 15.8
work 15.2
chair 15.2
brass 14.8
furniture 14.6
glass 14.2
design 14.1
empty 13.7
building 13.6
window 13.5
architecture 13.4
decor 13.2
indoors 13.2
table 12.2
structure 12.2
menorah 12.1
wind instrument 11.4
inside 11
kitchen 10.7
musical instrument 10.6
wicker 10.3
white goods 10.1
indoor 10
people 10
light 10
appliance 9.9
chairs 9.8
decoration 9.5
floor 9.3
product 9.1
urban 8.7
home appliance 8.5
blackboard 8.5
machine 8.5
business 8.5
relaxation 8.4
clean 8.3
life 8.1
candelabrum 8.1
lifestyle 7.9
women 7.9
tables 7.9
render 7.8
residential 7.6
comfortable 7.6
elegance 7.5
technology 7.4
black 7.2
open 7.2

Google
created on 2022-01-16

Head 97.2
Photograph 94.3
Window 93.7
White 92.2
Black 90
Black-and-white 87.6
Flowerpot 85.3
Style 84
Christmas tree 80.8
Christmas ornament 80.6
People 78.6
Monochrome photography 77.5
Monochrome 77.4
Child 75
Snapshot 74.3
Event 73.1
Toddler 72.2
Curtain 72.1
Fun 70.6
Room 70.2

Microsoft
created on 2022-01-16

person 99.1
christmas tree 92.1
clothing 91.9
outdoor 87.4
text 73.6
human face 70.1
black and white 68.8
group 68.5
posing 66.7
woman 57.3
family 20.6
crowd 1

Face analysis

Amazon

Google

AWS Rekognition

Age 43-51
Gender Female, 58.2%
Surprised 61.7%
Fear 14.6%
Calm 12.9%
Sad 4.3%
Disgusted 2.4%
Angry 1.9%
Confused 1.8%
Happy 0.6%

AWS Rekognition

Age 38-46
Gender Male, 97.4%
Happy 38.1%
Surprised 31.3%
Fear 22.9%
Calm 3.7%
Angry 1.5%
Sad 1.4%
Disgusted 0.8%
Confused 0.3%

AWS Rekognition

Age 20-28
Gender Male, 99.8%
Calm 99.4%
Sad 0.4%
Happy 0.1%
Confused 0.1%
Angry 0%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 20-28
Gender Male, 92%
Surprised 76.6%
Calm 15.7%
Fear 3.1%
Angry 2.2%
Disgusted 0.8%
Confused 0.7%
Sad 0.6%
Happy 0.2%

AWS Rekognition

Age 13-21
Gender Male, 97.5%
Calm 90.7%
Sad 7.6%
Surprised 0.6%
Angry 0.4%
Confused 0.4%
Disgusted 0.2%
Happy 0.1%
Fear 0.1%

AWS Rekognition

Age 18-24
Gender Female, 95.9%
Calm 28.2%
Surprised 26.8%
Disgusted 16%
Angry 9.6%
Confused 6.9%
Fear 5.6%
Sad 4.6%
Happy 2.4%

AWS Rekognition

Age 6-14
Gender Male, 95.1%
Surprised 93.4%
Fear 4.1%
Calm 1.3%
Sad 0.3%
Angry 0.3%
Disgusted 0.3%
Confused 0.1%
Happy 0.1%

AWS Rekognition

Age 18-26
Gender Female, 93.6%
Surprised 59.6%
Calm 35.3%
Fear 3.1%
Happy 0.7%
Sad 0.6%
Disgusted 0.4%
Angry 0.2%
Confused 0.1%

AWS Rekognition

Age 22-30
Gender Male, 91.8%
Calm 99.7%
Sad 0.2%
Happy 0%
Disgusted 0%
Surprised 0%
Confused 0%
Fear 0%
Angry 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Christmas Tree 55.5%

Captions

Microsoft

a group of people posing for a photo 97%
a group of people posing for the camera 96.9%
a group of people posing for a picture 96.8%

Text analysis

Amazon

KODAK-SVEELA

Google

YT33A2 -XAGOX
YT33A2
-XAGOX