Human Generated Data

Title

Untitled (couple posed with their three sons in front of Christmas tree)

Date

1962

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9876

Human Generated Data

Title

Untitled (couple posed with their three sons in front of Christmas tree)

People

Artist: Martin Schweig, American 20th century

Date

1962

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Clothing 99.8
Apparel 99.8
Person 99.6
Human 99.6
Person 99.4
Person 99.1
Person 99
Person 98.4
Face 98.2
Dress 96.1
Shorts 94.2
Suit 93.9
Coat 93.9
Overcoat 93.9
Smile 92.9
Female 92.5
Pants 88
Shirt 85.5
Nature 85.3
Outdoors 84.9
Head 82.8
People 81.6
Woman 80.3
Portrait 77.7
Photography 77.7
Photo 77.7
Glasses 75.2
Accessories 75.2
Accessory 75.2
Meal 73.7
Food 73.7
Creme 71.8
Cake 71.8
Icing 71.8
Cream 71.8
Dessert 71.8
Man 71.5
Vacation 69.8
Furniture 68.7
Water 67.3
Girl 65.6
Tuxedo 65.3
City 65.2
Town 65.2
Urban 65.2
Building 65.2
Plant 59.1
Collage 58
Advertisement 58
Poster 58
Jacket 57.9
Ocean 57.3
Sea 57.3
Tie 56.6

Imagga
created on 2022-01-28

kin 62.5
beach 39.6
man 37.9
people 32.9
couple 30.5
love 26.8
adult 25.7
happiness 25.1
person 25.1
male 24.3
sea 23.5
happy 22.6
groom 20.5
sand 20.1
summer 19.9
family 19.6
fun 19.5
vacation 18.8
two 18.6
water 18
outdoors 17.9
parent 17.9
father 17.9
life 17.8
smiling 17.4
lifestyle 17.4
men 17.2
portrait 16.8
together 16.7
mother 16.6
ocean 16.6
women 15.8
holiday 15.8
child 15.5
walking 15.2
dad 14.2
businessman 14.1
bride 13.6
coast 13.5
leisure 13.3
outdoor 13
smile 12.8
business 12.8
romance 12.5
relationship 12.2
wedding 12
day 11.8
joy 11.7
wife 11.4
cheerful 11.4
fashion 11.3
sexy 11.2
sunny 11.2
husband 11
dress 10.8
sunset 10.8
silhouette 10.8
sunlight 10.7
married 10.5
boy 10.4
outside 10.3
sky 10.2
grandfather 10.1
bright 10
son 10
holding 9.9
attractive 9.8
world 9.7
group 9.7
marriage 9.5
friends 9.4
casual 9.3
shore 9.3
suit 9.3
sun 8.9
office 8.8
home 8.8
standing 8.7
walk 8.6
tropical 8.5
vacations 8.5
enjoy 8.5
friendship 8.4
relax 8.4
pretty 8.4
girls 8.2
handsome 8
black 7.8
ceremony 7.8
travel 7.7
old 7.7
coastline 7.5
senior 7.5
room 7.5
clothing 7.5
park 7.4
20s 7.3
adolescent 7.3
relaxing 7.3
kid 7.1
job 7.1

Google
created on 2022-01-28

Photograph 94.2
Shorts 89.7
Black-and-white 85.9
Gesture 85.3
Style 83.9
Window 80.8
Monochrome 74.4
Snapshot 74.3
Monochrome photography 73.6
Font 72.2
Event 70.2
Art 70.2
Vintage clothing 69.3
Room 66.7
Stock photography 65.2
Pattern 64.5
Visual arts 61.2
History 56.8
Suit 56
Fun 55.6

Microsoft
created on 2022-01-28

text 97.3
person 86
outdoor 85.9
clothing 85.3
smile 69.2
woman 61.1
man 56.4
posing 43.3

Face analysis

Amazon

Google

AWS Rekognition

Age 45-53
Gender Male, 99.9%
Happy 87.9%
Surprised 5.1%
Calm 4.4%
Confused 1%
Sad 0.7%
Disgusted 0.5%
Angry 0.3%
Fear 0.1%

AWS Rekognition

Age 26-36
Gender Male, 99.7%
Calm 98.8%
Surprised 0.3%
Sad 0.3%
Confused 0.2%
Happy 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 38-46
Gender Male, 99.5%
Happy 53.8%
Calm 33.2%
Sad 3.6%
Angry 3.6%
Confused 2.5%
Disgusted 1.9%
Surprised 0.8%
Fear 0.4%

AWS Rekognition

Age 42-50
Gender Male, 94.7%
Happy 79.8%
Calm 9.7%
Sad 6.2%
Confused 1.5%
Surprised 1%
Disgusted 0.9%
Fear 0.4%
Angry 0.3%

AWS Rekognition

Age 26-36
Gender Female, 80.3%
Happy 85.2%
Calm 11%
Confused 1.2%
Fear 0.7%
Sad 0.7%
Surprised 0.6%
Disgusted 0.5%
Angry 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a group of people posing for a photo 90.7%
a group of people posing for the camera 90.6%
a group of people posing for a picture 90.5%